Jul 13 21:09:14.516448 ip-10-0-128-82 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.018078    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022413    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022425    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022429    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022433    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022436    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022440    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022445    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:09:15.049068 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022448    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022451    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022453    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022456    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022458    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022461    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022464    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022466    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022469    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022472    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022475    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022479    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022493    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022496    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022499    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022502    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022505    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022507    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022510    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:09:15.110832 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022513    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022515    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022518    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022520    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022523    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022525    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022528    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022531    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022534    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022537    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022539    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022542    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022545    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022548    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022551    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022553    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022556    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022559    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022561    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022564    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:09:15.114555 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022566    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022571    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022575    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022578    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022580    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022583    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022587    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022590    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022593    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022595    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022598    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022601    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022603    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022606    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022609    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022611    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022614    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022617    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022619    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022622    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:09:15.119381 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022624    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:09:15.116983 ip-10-0-128-82 systemd[1]: Started Kubernetes Kubelet.
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022627    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022629    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022632    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022636    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022638    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022641    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022644    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022646    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022649    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022651    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022654    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022656    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022659    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022661    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022664    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022666    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022669    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022672    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022675    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:09:15.128160 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022679    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022682    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022686    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022689    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022692    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022694    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022700    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022702    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022705    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022707    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022710    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022712    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.022715    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023447    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023455    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023458    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023462    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023464    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023467    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:09:15.131061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023470    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023472    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023475    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023478    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023481    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023483    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023486    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023489    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023493    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023496    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023499    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023502    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023504    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023507    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023510    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023512    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023515    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023518    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023520    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023524    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:09:15.134711 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023527    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023529    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023532    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023536    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023540    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023543    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023546    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023551    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023554    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023557    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023560    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023562    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023566    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023570    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023573    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023576    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023579    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023581    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023584    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:09:15.138230 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023587    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023589    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023591    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023594    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023597    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023599    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023602    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023605    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023607    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023610    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023612    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023615    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023619    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023622    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023625    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023627    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023630    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023632    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023635    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023638    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:09:15.143385 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023641    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023644    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023646    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023649    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023651    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023654    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023656    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023659    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023661    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023664    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023666    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023669    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023671    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023674    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023676    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023679    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023681    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023684    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023686    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023688    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:09:15.147077 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023691    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023694    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023696    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023699    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023702    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023705    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023707    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023710    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023712    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023715    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023717    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023720    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023724    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.023726    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024684    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024691    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024695    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024698    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024702    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024705    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:09:15.152217 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024707    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024711    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024713    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024716    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024719    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024721    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024725    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024729    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024732    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024735    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024738    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024741    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024752    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024755    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024758    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024762    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024767    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024771    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024773    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024776    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:09:15.307265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024778    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024781    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024784    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024787    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024791    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024794    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024796    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024799    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024801    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024804    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024806    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024809    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024811    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024814    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024816    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024819    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024821    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024824    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024826    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:09:15.321093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024829    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024831    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024835    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024837    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024840    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024842    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024845    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024847    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024850    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024854    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024856    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024859    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024861    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024864    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024866    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024869    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024871    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024876    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024878    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024881    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:09:15.322145 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024883    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024886    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024888    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024891    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024893    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024896    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024898    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024901    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024903    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024906    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024908    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024911    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024913    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024915    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024918    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024920    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024924    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024927    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024930    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024933    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:09:15.323202 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024936    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024939    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024942    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024944    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024947    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024949    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024952    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024954    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024957    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024960    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024963    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024965    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024968    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.024970    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025036    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025043    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025056    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025061    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025065    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025068    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025072    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 21:09:15.324158 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025076    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025080    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025082    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025086    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025090    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025093    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025096    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025098    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025101    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025104    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025107    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025111    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025115    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025119    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025122    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025125    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025129    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025132    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025135    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025138    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025142    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025145    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025148    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025151    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 21:09:15.326619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025154    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025158    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025161    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025163    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025166    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025188    2580 flags.go:64] FLAG: --enable-server="true"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025192    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025199    2580 flags.go:64] FLAG: --event-burst="100"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025202    2580 flags.go:64] FLAG: --event-qps="50"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025205    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025207    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025211    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025215    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025218    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025234    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025237    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025241    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025244    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025248    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025251    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025256    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025259    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025261    2580 flags.go:64] FLAG: --feature-gates=""
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025265    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025268    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 21:09:15.328592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025271    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025274    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025277    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025281    2580 flags.go:64] FLAG: --help="false"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025284    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025287    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025290    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025293    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025296    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025300    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025302    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025305    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025308    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025310    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025313    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025316    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025319    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025321    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025324    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025327    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025330    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025332    2580 flags.go:64] FLAG: --lock-file=""
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025335    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025338    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 21:09:15.331638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025340    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025345    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025348    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025352    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025356    2580 flags.go:64] FLAG: --logging-format="text"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025359    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025362    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025365    2580 flags.go:64] FLAG: --manifest-url=""
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025367    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025371    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025374    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025380    2580 flags.go:64] FLAG: --max-pods="110"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025383    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025385    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025388    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025391    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025394    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025397    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025400    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025407    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025410    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025412    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025416    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 13 21:09:15.333676 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025419    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025424    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025427    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025430    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025433    2580 flags.go:64] FLAG: --port="10250"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025436    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025439    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ec3a96922276e372"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025442    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025445    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025447    2580 flags.go:64] FLAG: --register-node="true"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025450    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025454    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025457    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025461    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025465    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025468    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025471    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025474    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025477    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025480    2580 flags.go:64] FLAG: --runonce="false"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025484    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025487    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025490    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025493    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025496    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025499    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 21:09:15.336181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025502    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025505    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025508    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025511    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025513    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025516    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025519    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025522    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025525    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025530    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025533    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025535    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025539    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025542    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025545    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025547    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025550    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025553    2580 flags.go:64] FLAG: --v="2"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025557    2580 flags.go:64] FLAG: --version="false"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025562    2580 flags.go:64] FLAG: --vmodule=""
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025565    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.025569    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025682    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025686    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:09:15.343793 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025690    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025693    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025698    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025701    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025704    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025707    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025709    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025713    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025715    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025718    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025720    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025723    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025726    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025728    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025732    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025735    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025738    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025741    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025743    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025746    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:09:15.344598 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025749    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025751    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025754    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025756    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025759    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025761    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025764    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025768    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025771    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025773    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025779    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025782    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025785    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025789    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025794    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025797    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025800    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025803    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:09:15.355451 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025806    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025808    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025811    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025813    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025816    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025819    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025821    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025824    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025827    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025829    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025832    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025834    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025837    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025839    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025842    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025844    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025847    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025849    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025851    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025854    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:09:15.356253 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025856    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025861    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025864    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025866    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025869    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025872    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025875    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025878    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025881    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025884    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025886    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025889    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025892    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025894    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025897    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025899    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025902    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025904    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025907    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025909    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:09:15.357056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025912    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025915    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025918    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025920    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025923    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025925    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025928    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025930    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025933    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025935    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025938    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025940    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025943    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025947    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025950    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025952    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025955    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025957    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:09:15.357867 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.025960    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.026704    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.055958    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.055973    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.055998    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.056004    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056060    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056065    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056069    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056072    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056076    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056079    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056082    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056085    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056087    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:09:15.358642 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056090    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056093    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056096    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056098    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056101    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056104    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056107    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056111    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056115    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056118    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056121    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056124    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056127    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056130    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056133    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056136    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056138    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056141    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056144    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:09:15.359447 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056147    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056150    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056152    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056156    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056159    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056161    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056164    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056166    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056183    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056186    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056190    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056193    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056196    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056200    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056203    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056206    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056208    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056211    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056216    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:09:15.360254 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056219    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056221    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056224    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056227    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056229    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056232    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056234    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056237    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056239    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056242    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056245    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056248    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056252    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056255    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056258    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056260    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056263    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056266    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056268    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056271    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:09:15.361050 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056274    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056278    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056280    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056284    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056287    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056290    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056293    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056295    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056298    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056300    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056303    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056306    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056309    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056311    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056314    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056317    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056319    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056322    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056324    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056327    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:09:15.361840 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056329    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056332    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056334    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056337    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056340    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056343    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056346    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056348    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056351    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056353    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056356    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056359    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.056364    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056473    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056480    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:09:15.363443 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056483    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056487    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056489    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056493    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056496    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056499    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056502    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056505    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056507    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056510    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056515    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056518    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056521    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056523    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056526    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056528    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056531    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056534    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056536    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056539    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:09:15.364229 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056541    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056547    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056551    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056553    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056556    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056559    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056562    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056565    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056567    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056570    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056572    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056576    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056579    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056583    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056586    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056588    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056591    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056593    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056596    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:09:15.486560 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056599    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056601    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056604    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056606    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056610    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056612    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056615    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056617    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056620    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056623    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056626    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056629    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056631    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056634    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056638    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056640    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056643    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056646    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056648    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056651    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:09:15.487198 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056653    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056656    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056659    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056662    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056667    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056671    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056674    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056677    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056679    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056682    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056685    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056688    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056690    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056693    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056695    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056698    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056700    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056704    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056706    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:09:15.487837 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056709    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056712    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056714    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056717    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056719    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056722    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056724    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056728    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056731    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056733    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056736    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056739    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056741    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056753    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056756    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056758    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056761    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056764    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:09:15.488368 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:15.056767    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:09:15.488891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.056772    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 21:09:15.488891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.056885    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 21:09:15.488891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.061040    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 21:09:15.488891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.062507    2580 server.go:1019] "Starting client certificate rotation"
Jul 13 21:09:15.488891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.062608    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 21:09:15.488891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.062644    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 21:09:15.488891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.065786    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 21:09:15.488891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.067007    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 21:09:15.488891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.080856    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 13 21:09:15.488891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.083060    2580 log.go:25] "Validated CRI v1 image API"
Jul 13 21:09:15.488891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.083888    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 21:09:15.488891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.086259    2580 fs.go:135] Filesystem UUIDs: map[5b7580d7-ced9-4d25-ba09-57636103f232:/dev/nvme0n1p4 75f0c918-4992-4cdd-8287-3208b1244842:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 13 21:09:15.489259 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.086289    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 21:09:15.489259 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.092197    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.092890    2580 manager.go:216] Machine: {Timestamp:2026-07-13 21:09:15.091526806 +0000 UTC m=+0.423881387 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100636 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dd3bfc35f6e7854042a6124cd46f6 SystemUUID:ec2dd3bf-c35f-6e78-5404-2a6124cd46f6 BootID:aee6e600-e30e-4411-b2ef-5148607cd336 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:98:59:eb:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:98:59:eb:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:51:d5:92:a7:bc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.092995    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.093082    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.097477    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.097501    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-82.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.098311    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.098322    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.098329    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.099013    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.100362    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.103501    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.103623    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.103651    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.103666    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.103678    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.103687    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.103696    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 21:09:15.489432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.104049    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.104066    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.107734    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-brr2p"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.108185    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110219    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110260    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110414    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110427    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110433    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110439    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110447    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110453    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110923    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110932    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110939    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110944    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110953    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.110966    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.112254    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.112341    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.112696    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.112705    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.115296    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-brr2p"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.115340    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-82.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.116157    2580 server.go:1268] "Started kubelet"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.116260    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.116397    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.116460    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.117752    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.118988    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.122287    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.122677    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.122698    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.122750    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.123454    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.123500    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.123518    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.123630    2580 factory.go:55] Registering systemd factory
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.123644    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.123657    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.123665    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.123834    2580 factory.go:153] Registering CRI-O factory
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.123847    2580 factory.go:223] Registration of the crio container factory successfully
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.123891    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.123912    2580 factory.go:103] Registering Raw factory
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.123927    2580 manager.go:1196] Started watching for new ooms in manager
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.124433    2580 manager.go:349] Starting recovery of all containers
Jul 13 21:09:15.489974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.124973    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.134380    2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-82.ec2.internal\" not found" node="ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.139876    2580 manager.go:354] Recovery completed
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.144154    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.145975    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.146007    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.146021    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.146636    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.146637    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.146669    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.146687    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.147428    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.147457    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.147470    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.147815    2580 policy_none.go:49] "None policy: Start"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.147831    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.147844    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.148876    2580 policy_none.go:47] "Start"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.182819    2580 manager.go:337] "Starting Device Plugin manager"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.182850    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.182862    2580 server.go:87] "Starting device plugin registration server"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.183129    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.183141    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.183321    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.183405    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.183415    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.183878    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.183930    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.229097    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.230242    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.230272    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.230291    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.230322    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.232806    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.283817    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.284712    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.284755    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.284767    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.284791    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.293103    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.293120    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-82.ec2.internal\": node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.304117    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.405194    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"]
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.405264    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.405181    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.406101    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:09:15.491627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.406125    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.406136    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.407404    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.407506    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.407534    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.408058    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.408080    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.408089    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.408101    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.408128    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.408138    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.409319    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.409341    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.409897    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.409926    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.409939    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.426205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69112e71603383d0f97eae91b3fd05e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"69112e71603383d0f97eae91b3fd05e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.426226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69112e71603383d0f97eae91b3fd05e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"69112e71603383d0f97eae91b3fd05e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.426244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d094537333ce6cfa1746d8c5a70fd11-config\") pod \"kube-apiserver-proxy-ip-10-0-128-82.ec2.internal\" (UID: \"1d094537333ce6cfa1746d8c5a70fd11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.429685    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-82.ec2.internal\" not found" node="ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.492907 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.433750    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-82.ec2.internal\" not found" node="ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.603008 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.505734    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:15.603008 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.527038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69112e71603383d0f97eae91b3fd05e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"69112e71603383d0f97eae91b3fd05e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.603008 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.527059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69112e71603383d0f97eae91b3fd05e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"69112e71603383d0f97eae91b3fd05e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.603008 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.527076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d094537333ce6cfa1746d8c5a70fd11-config\") pod \"kube-apiserver-proxy-ip-10-0-128-82.ec2.internal\" (UID: \"1d094537333ce6cfa1746d8c5a70fd11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.603008 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.527119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d094537333ce6cfa1746d8c5a70fd11-config\") pod \"kube-apiserver-proxy-ip-10-0-128-82.ec2.internal\" (UID: \"1d094537333ce6cfa1746d8c5a70fd11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.603008 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.527147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69112e71603383d0f97eae91b3fd05e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"69112e71603383d0f97eae91b3fd05e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.603008 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.527152    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69112e71603383d0f97eae91b3fd05e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"69112e71603383d0f97eae91b3fd05e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:15.606938 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.606403    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:15.718616 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:15.706870    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:17.342556 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.732387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:17.342556 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:15.736484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:17.342556 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:17.284670    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:17.454051 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:17.385157    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:17.565413 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:17.485634    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:17.565413 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:17.539149    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 21:09:17.565413 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:17.539314    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 21:09:17.565413 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:17.539336    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 21:09:17.586548 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:17.585705    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:17.682466 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:17.596825    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 21:04:16 +0000 UTC" deadline="2028-02-09 17:34:22.37826393 +0000 UTC"
Jul 13 21:09:17.682466 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:17.596847    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13820h25m4.781419114s"
Jul 13 21:09:17.688445 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:17.686127    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:17.809166 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:17.786375    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:17.940448 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:17.886909    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:18.058377 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:17.987370    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:18.058377 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.032243    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:09:18.182652 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:18.088204    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Jul 13 21:09:18.182652 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.093358    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:09:18.182652 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.100839    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:18.182652 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.110006    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 21:09:18.182652 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.110832    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Jul 13 21:09:18.182652 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.122312    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 21:09:18.308940 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:18.209669    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69112e71603383d0f97eae91b3fd05e2.slice/crio-5bf056b9855f05a42cb8bf1562c933ae1cedcd3a43940a396383c7becf7622d4 WatchSource:0}: Error finding container 5bf056b9855f05a42cb8bf1562c933ae1cedcd3a43940a396383c7becf7622d4: Status 404 returned error can't find the container with id 5bf056b9855f05a42cb8bf1562c933ae1cedcd3a43940a396383c7becf7622d4
Jul 13 21:09:18.308940 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:18.209879    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d094537333ce6cfa1746d8c5a70fd11.slice/crio-3bf912172737e1e6bf52a3588433bf43dd1a78550947047946819de5f06e3306 WatchSource:0}: Error finding container 3bf912172737e1e6bf52a3588433bf43dd1a78550947047946819de5f06e3306: Status 404 returned error can't find the container with id 3bf912172737e1e6bf52a3588433bf43dd1a78550947047946819de5f06e3306
Jul 13 21:09:18.308940 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.213652    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:09:18.581839 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.581808    2580 apiserver.go:52] "Watching apiserver"
Jul 13 21:09:18.593159 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.593138    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 21:09:18.593498 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.593477    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-2d9kz","openshift-network-operator/iptables-alerter-4wwss","openshift-ovn-kubernetes/ovnkube-node-l84wn","kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs","openshift-dns/node-resolver-gpsp2","openshift-image-registry/node-ca-p8xlt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal","openshift-multus/multus-67xqp","openshift-multus/multus-additional-cni-plugins-clhj6","openshift-multus/network-metrics-daemon-b86vq","kube-system/global-pull-secret-syncer-2b859","kube-system/konnectivity-agent-xs8jp","openshift-cluster-node-tuning-operator/tuned-kbwt7"]
Jul 13 21:09:18.595745 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.595728    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.597054 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.597035    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xs8jp"
Jul 13 21:09:18.598157 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.598142    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 21:09:18.598230 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.598146    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 21:09:18.598230 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.598202    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 21:09:18.598401 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.598374    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6q2bl\""
Jul 13 21:09:18.598457 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.598445    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 21:09:18.598509 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.598462    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 21:09:18.598895 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.598808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.598895 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.598860    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 21:09:18.598895 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.598871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qh4tz\""
Jul 13 21:09:18.599071 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.598815    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 21:09:18.600052 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.600034    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 21:09:18.600555 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.600531    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.600717 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.600698    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 21:09:18.600810 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.600533    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 21:09:18.600946 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.600929    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 21:09:18.601064 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.601050    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 21:09:18.601142 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.601127    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 21:09:18.601220 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.601206    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 21:09:18.601277 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.601135    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z5wh6\""
Jul 13 21:09:18.602034 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.602019    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.602662 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.602637    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:09:18.602749 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.602700    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 21:09:18.674911 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.674883    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 21:09:18.675057 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.674930    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 21:09:18.675120 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.675080    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:09:18.675176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.675157    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vvqn8\""
Jul 13 21:09:18.675290 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.675271    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gqnh6\""
Jul 13 21:09:18.679623 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.679601    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 21:09:18.679736 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.679693    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2fg77"
Jul 13 21:09:18.688889 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.688745    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 21:09:18.690634 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.690608    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gpsp2"
Jul 13 21:09:18.693817 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.692613    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 21:09:18.693817 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.692882    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 21:09:18.693817 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.692905    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p7v8n\""
Jul 13 21:09:18.693817 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.693725    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.695035 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc8vw\" (UniqueName: \"kubernetes.io/projected/19344c9e-fc2c-4cb5-84de-2f024b60eabf-kube-api-access-xc8vw\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.695127 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-systemd-units\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.695127 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-run-netns\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.695127 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-run-ovn\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.695127 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695118    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-sysctl-d\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.695415 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-node-log\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.695415 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-run\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.695415 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-var-lib-kubelet\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.695415 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45xc9\" (UniqueName: \"kubernetes.io/projected/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-kube-api-access-45xc9\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.695415 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19344c9e-fc2c-4cb5-84de-2f024b60eabf-cni-binary-copy\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.695415 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19344c9e-fc2c-4cb5-84de-2f024b60eabf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.695415 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-cni-netd\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.695415 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-sysconfig\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.695415 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-lib-modules\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p8xlt"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gt5v\" (UniqueName: \"kubernetes.io/projected/4e1297c7-117c-42c9-82f6-9e3aaaa78311-kube-api-access-9gt5v\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695618    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695620    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-socket-dir\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-etc-selinux\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19344c9e-fc2c-4cb5-84de-2f024b60eabf-os-release\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19344c9e-fc2c-4cb5-84de-2f024b60eabf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-var-lib-openvswitch\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695739    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-etc-openvswitch\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-sysctl-conf\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695817    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-sys\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695838    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-host\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/662201cc-a8f3-42cc-8ce1-1f9d7d2867bd-agent-certs\") pod \"konnectivity-agent-xs8jp\" (UID: \"662201cc-a8f3-42cc-8ce1-1f9d7d2867bd\") " pod="kube-system/konnectivity-agent-xs8jp"
Jul 13 21:09:18.695913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-log-socket\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/342572ad-5e24-4e80-88ae-7adbfeb3764b-ovnkube-config\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.695996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsjkd\" (UniqueName: \"kubernetes.io/projected/342572ad-5e24-4e80-88ae-7adbfeb3764b-kube-api-access-zsjkd\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-sys-fs\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-slash\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696093    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-run-systemd\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696128    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-run-openvswitch\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-cni-bin\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/342572ad-5e24-4e80-88ae-7adbfeb3764b-ovn-node-metrics-cert\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696199    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-flzzf\""
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e1297c7-117c-42c9-82f6-9e3aaaa78311-tmp\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696248    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19344c9e-fc2c-4cb5-84de-2f024b60eabf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/342572ad-5e24-4e80-88ae-7adbfeb3764b-ovnkube-script-lib\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-systemd\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-tuned\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696418    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-registration-dir\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.696619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-device-dir\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.697542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19344c9e-fc2c-4cb5-84de-2f024b60eabf-cnibin\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.697542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.697542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/342572ad-5e24-4e80-88ae-7adbfeb3764b-env-overrides\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.697542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-modprobe-d\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.697542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696573    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-kubernetes\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.697542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/662201cc-a8f3-42cc-8ce1-1f9d7d2867bd-konnectivity-ca\") pod \"konnectivity-agent-xs8jp\" (UID: \"662201cc-a8f3-42cc-8ce1-1f9d7d2867bd\") " pod="kube-system/konnectivity-agent-xs8jp"
Jul 13 21:09:18.697542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-kubelet\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.697542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.696901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19344c9e-fc2c-4cb5-84de-2f024b60eabf-system-cni-dir\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.697542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.697074    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4wwss"
Jul 13 21:09:18.698223 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.697804    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 21:09:18.698299 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.698241    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tqlwk\""
Jul 13 21:09:18.698349 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.698325    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 21:09:18.698507 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.698488    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 21:09:18.698599 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.698566    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:18.698661 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:18.698639    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:18.698906 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.698890    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 21:09:18.698981 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.698922    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 21:09:18.699044 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.698977    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5vgv9\""
Jul 13 21:09:18.699087 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.699072    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:09:18.699987 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.699972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:18.700061 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:18.700029    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:18.701742 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.701708    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:18.701822 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:18.701763    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:18.712236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.712172    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" event={"ID":"1d094537333ce6cfa1746d8c5a70fd11","Type":"ContainerStarted","Data":"3bf912172737e1e6bf52a3588433bf43dd1a78550947047946819de5f06e3306"}
Jul 13 21:09:18.713495 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.713474    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" event={"ID":"69112e71603383d0f97eae91b3fd05e2","Type":"ContainerStarted","Data":"5bf056b9855f05a42cb8bf1562c933ae1cedcd3a43940a396383c7becf7622d4"}
Jul 13 21:09:18.723220 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.723205    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:09:18.797713 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q29ts\" (UniqueName: \"kubernetes.io/projected/4aad42e4-7f0c-474b-97a4-4ae36af5637f-kube-api-access-q29ts\") pod \"iptables-alerter-4wwss\" (UID: \"4aad42e4-7f0c-474b-97a4-4ae36af5637f\") " pod="openshift-network-operator/iptables-alerter-4wwss"
Jul 13 21:09:18.797853 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-slash\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.797853 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-run-openvswitch\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.797853 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-cni-bin\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.797853 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.797853 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-slash\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.797853 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-device-dir\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-os-release\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797890    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-device-dir\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-var-lib-cni-bin\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797925    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-var-lib-cni-multus\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-run-openvswitch\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19344c9e-fc2c-4cb5-84de-2f024b60eabf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/342572ad-5e24-4e80-88ae-7adbfeb3764b-ovnkube-script-lib\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.797995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-cni-bin\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.798014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-systemd\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.798042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-tuned\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.798067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-registration-dir\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.798090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f46d7a90-17ca-474d-8c35-e44e1e222184-multus-daemon-config\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.798113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08b33c6b-c74d-4666-a461-47432d836c89-host\") pod \"node-ca-p8xlt\" (UID: \"08b33c6b-c74d-4666-a461-47432d836c89\") " pod="openshift-image-registry/node-ca-p8xlt"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.798137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19344c9e-fc2c-4cb5-84de-2f024b60eabf-cnibin\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.798196 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.798171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.799416 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.799377    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/342572ad-5e24-4e80-88ae-7adbfeb3764b-env-overrides\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.799501 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.799420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19344c9e-fc2c-4cb5-84de-2f024b60eabf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.799759 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.799721    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 21:09:18.800054 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800023    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/342572ad-5e24-4e80-88ae-7adbfeb3764b-ovnkube-script-lib\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.800133 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-systemd\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.800133 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.798042    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.800204 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-registration-dir\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.800285 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19344c9e-fc2c-4cb5-84de-2f024b60eabf-cnibin\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.800351 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800326    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.798195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/342572ad-5e24-4e80-88ae-7adbfeb3764b-env-overrides\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-kubernetes\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-run-k8s-cni-cncf-io\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md6qv\" (UniqueName: \"kubernetes.io/projected/9482820b-d3b9-4d4e-b538-6c33fcbf5312-kube-api-access-md6qv\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4aad42e4-7f0c-474b-97a4-4ae36af5637f-iptables-alerter-script\") pod \"iptables-alerter-4wwss\" (UID: \"4aad42e4-7f0c-474b-97a4-4ae36af5637f\") " pod="openshift-network-operator/iptables-alerter-4wwss"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19344c9e-fc2c-4cb5-84de-2f024b60eabf-system-cni-dir\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc8vw\" (UniqueName: \"kubernetes.io/projected/19344c9e-fc2c-4cb5-84de-2f024b60eabf-kube-api-access-xc8vw\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800812    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-kubernetes\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-system-cni-dir\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aad42e4-7f0c-474b-97a4-4ae36af5637f-host-slash\") pod \"iptables-alerter-4wwss\" (UID: \"4aad42e4-7f0c-474b-97a4-4ae36af5637f\") " pod="openshift-network-operator/iptables-alerter-4wwss"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800890    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19344c9e-fc2c-4cb5-84de-2f024b60eabf-system-cni-dir\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-node-log\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-run\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.801007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.800954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-node-log\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.801721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-run\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.801721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-var-lib-kubelet\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.801721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45xc9\" (UniqueName: \"kubernetes.io/projected/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-kube-api-access-45xc9\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.801721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-multus-socket-dir-parent\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.801721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19344c9e-fc2c-4cb5-84de-2f024b60eabf-cni-binary-copy\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.801721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-sysconfig\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.801721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-etc-selinux\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.801721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801587    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-etc-selinux\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.801721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19344c9e-fc2c-4cb5-84de-2f024b60eabf-os-release\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.801721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19344c9e-fc2c-4cb5-84de-2f024b60eabf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.801721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-host\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-run-netns\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-var-lib-kubelet\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/662201cc-a8f3-42cc-8ce1-1f9d7d2867bd-agent-certs\") pod \"konnectivity-agent-xs8jp\" (UID: \"662201cc-a8f3-42cc-8ce1-1f9d7d2867bd\") " pod="kube-system/konnectivity-agent-xs8jp"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/342572ad-5e24-4e80-88ae-7adbfeb3764b-ovnkube-config\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsjkd\" (UniqueName: \"kubernetes.io/projected/342572ad-5e24-4e80-88ae-7adbfeb3764b-kube-api-access-zsjkd\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f46d7a90-17ca-474d-8c35-e44e1e222184-cni-binary-copy\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.801964    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-run-multus-certs\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23ac8fbb-a563-481d-87cc-49188ab19fc4-kubelet-config\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-run-systemd\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/342572ad-5e24-4e80-88ae-7adbfeb3764b-ovn-node-metrics-cert\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19344c9e-fc2c-4cb5-84de-2f024b60eabf-cni-binary-copy\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e1297c7-117c-42c9-82f6-9e3aaaa78311-tmp\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6vhs\" (UniqueName: \"kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs\") pod \"network-check-target-2d9kz\" (UID: \"5f63c403-8578-484c-a608-54939ba529d6\") " pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-multus-cni-dir\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802218    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1a7f988-c495-4a1a-a6d6-372164fd830b-hosts-file\") pod \"node-resolver-gpsp2\" (UID: \"d1a7f988-c495-4a1a-a6d6-372164fd830b\") " pod="openshift-dns/node-resolver-gpsp2"
Jul 13 21:09:18.802237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krsw5\" (UniqueName: \"kubernetes.io/projected/d1a7f988-c495-4a1a-a6d6-372164fd830b-kube-api-access-krsw5\") pod \"node-resolver-gpsp2\" (UID: \"d1a7f988-c495-4a1a-a6d6-372164fd830b\") " pod="openshift-dns/node-resolver-gpsp2"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802275    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23ac8fbb-a563-481d-87cc-49188ab19fc4-dbus\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-modprobe-d\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-hostroot\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08b33c6b-c74d-4666-a461-47432d836c89-serviceca\") pod \"node-ca-p8xlt\" (UID: \"08b33c6b-c74d-4666-a461-47432d836c89\") " pod="openshift-image-registry/node-ca-p8xlt"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/662201cc-a8f3-42cc-8ce1-1f9d7d2867bd-konnectivity-ca\") pod \"konnectivity-agent-xs8jp\" (UID: \"662201cc-a8f3-42cc-8ce1-1f9d7d2867bd\") " pod="kube-system/konnectivity-agent-xs8jp"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19344c9e-fc2c-4cb5-84de-2f024b60eabf-os-release\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-kubelet\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-systemd-units\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802532    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-var-lib-kubelet\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-run-netns\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-run-ovn\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802625    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/342572ad-5e24-4e80-88ae-7adbfeb3764b-ovnkube-config\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802712    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-host\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19344c9e-fc2c-4cb5-84de-2f024b60eabf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802768    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-modprobe-d\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.802985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-sysctl-d\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-etc-kubernetes\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-run-systemd\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-sysctl-d\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-sysconfig\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803161    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-run-netns\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.802937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w72wj\" (UniqueName: \"kubernetes.io/projected/08b33c6b-c74d-4666-a461-47432d836c89-kube-api-access-w72wj\") pod \"node-ca-p8xlt\" (UID: \"08b33c6b-c74d-4666-a461-47432d836c89\") " pod="openshift-image-registry/node-ca-p8xlt"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19344c9e-fc2c-4cb5-84de-2f024b60eabf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-cni-netd\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-lib-modules\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gt5v\" (UniqueName: \"kubernetes.io/projected/4e1297c7-117c-42c9-82f6-9e3aaaa78311-kube-api-access-9gt5v\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-socket-dir\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803562    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qttjp\" (UniqueName: \"kubernetes.io/projected/f46d7a90-17ca-474d-8c35-e44e1e222184-kube-api-access-qttjp\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-var-lib-openvswitch\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-etc-openvswitch\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-sysctl-conf\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-sys\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.803809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-sys-fs\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.804654 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803780    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1a7f988-c495-4a1a-a6d6-372164fd830b-tmp-dir\") pod \"node-resolver-gpsp2\" (UID: \"d1a7f988-c495-4a1a-a6d6-372164fd830b\") " pod="openshift-dns/node-resolver-gpsp2"
Jul 13 21:09:18.804654 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-cnibin\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.804654 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-log-socket\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.804654 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-multus-conf-dir\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.804654 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:18.804654 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.803991    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/662201cc-a8f3-42cc-8ce1-1f9d7d2867bd-konnectivity-ca\") pod \"konnectivity-agent-xs8jp\" (UID: \"662201cc-a8f3-42cc-8ce1-1f9d7d2867bd\") " pod="kube-system/konnectivity-agent-xs8jp"
Jul 13 21:09:18.804654 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.804039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-var-lib-openvswitch\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.804654 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.804145    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-lib-modules\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.804654 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.804608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-systemd-units\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.804654 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.804640    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19344c9e-fc2c-4cb5-84de-2f024b60eabf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.805176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.804662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-kubelet\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.805176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.804714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-cni-netd\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.805176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.804723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-sys\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.805176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.804774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-sys-fs\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.805176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.804827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-etc-openvswitch\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.805176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.804939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-sysctl-conf\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.805176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.804960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-run-ovn\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.805176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.804992    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-log-socket\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.805176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.805065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-socket-dir\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.805176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.805160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342572ad-5e24-4e80-88ae-7adbfeb3764b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.805737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.805235    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 21:09:18.805737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.805365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/342572ad-5e24-4e80-88ae-7adbfeb3764b-ovn-node-metrics-cert\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.805737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.805557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e1297c7-117c-42c9-82f6-9e3aaaa78311-etc-tuned\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.806434 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.806410    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/662201cc-a8f3-42cc-8ce1-1f9d7d2867bd-agent-certs\") pod \"konnectivity-agent-xs8jp\" (UID: \"662201cc-a8f3-42cc-8ce1-1f9d7d2867bd\") " pod="kube-system/konnectivity-agent-xs8jp"
Jul 13 21:09:18.808101 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.808081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e1297c7-117c-42c9-82f6-9e3aaaa78311-tmp\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.810137 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.810085    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45xc9\" (UniqueName: \"kubernetes.io/projected/d7dc5d7b-98ef-4f09-bc4c-adabfc33b356-kube-api-access-45xc9\") pod \"aws-ebs-csi-driver-node-9xnqs\" (UID: \"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:18.811034 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.811010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc8vw\" (UniqueName: \"kubernetes.io/projected/19344c9e-fc2c-4cb5-84de-2f024b60eabf-kube-api-access-xc8vw\") pod \"multus-additional-cni-plugins-clhj6\" (UID: \"19344c9e-fc2c-4cb5-84de-2f024b60eabf\") " pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.811638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.811619    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gt5v\" (UniqueName: \"kubernetes.io/projected/4e1297c7-117c-42c9-82f6-9e3aaaa78311-kube-api-access-9gt5v\") pod \"tuned-kbwt7\" (UID: \"4e1297c7-117c-42c9-82f6-9e3aaaa78311\") " pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.811897 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.811876    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsjkd\" (UniqueName: \"kubernetes.io/projected/342572ad-5e24-4e80-88ae-7adbfeb3764b-kube-api-access-zsjkd\") pod \"ovnkube-node-l84wn\" (UID: \"342572ad-5e24-4e80-88ae-7adbfeb3764b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.904122 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qttjp\" (UniqueName: \"kubernetes.io/projected/f46d7a90-17ca-474d-8c35-e44e1e222184-kube-api-access-qttjp\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.904271 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1a7f988-c495-4a1a-a6d6-372164fd830b-tmp-dir\") pod \"node-resolver-gpsp2\" (UID: \"d1a7f988-c495-4a1a-a6d6-372164fd830b\") " pod="openshift-dns/node-resolver-gpsp2"
Jul 13 21:09:18.904271 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-cnibin\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.904271 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-cnibin\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.904444 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-multus-conf-dir\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.904444 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:18.904444 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q29ts\" (UniqueName: \"kubernetes.io/projected/4aad42e4-7f0c-474b-97a4-4ae36af5637f-kube-api-access-q29ts\") pod \"iptables-alerter-4wwss\" (UID: \"4aad42e4-7f0c-474b-97a4-4ae36af5637f\") " pod="openshift-network-operator/iptables-alerter-4wwss"
Jul 13 21:09:18.904444 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904437    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-multus-conf-dir\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.904688 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-os-release\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.904688 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904479    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1a7f988-c495-4a1a-a6d6-372164fd830b-tmp-dir\") pod \"node-resolver-gpsp2\" (UID: \"d1a7f988-c495-4a1a-a6d6-372164fd830b\") " pod="openshift-dns/node-resolver-gpsp2"
Jul 13 21:09:18.904688 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-var-lib-cni-bin\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.904688 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:18.904513    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:18.904688 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-var-lib-cni-multus\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.904688 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-os-release\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.904688 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f46d7a90-17ca-474d-8c35-e44e1e222184-multus-daemon-config\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.904688 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:18.904601    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret podName:23ac8fbb-a563-481d-87cc-49188ab19fc4 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:19.404579417 +0000 UTC m=+3.259724279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret") pod "global-pull-secret-syncer-2b859" (UID: "23ac8fbb-a563-481d-87cc-49188ab19fc4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:18.904688 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904602    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-var-lib-cni-bin\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.904688 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-var-lib-cni-multus\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.904688 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08b33c6b-c74d-4666-a461-47432d836c89-host\") pod \"node-ca-p8xlt\" (UID: \"08b33c6b-c74d-4666-a461-47432d836c89\") " pod="openshift-image-registry/node-ca-p8xlt"
Jul 13 21:09:18.904688 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-run-k8s-cni-cncf-io\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md6qv\" (UniqueName: \"kubernetes.io/projected/9482820b-d3b9-4d4e-b538-6c33fcbf5312-kube-api-access-md6qv\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904730    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08b33c6b-c74d-4666-a461-47432d836c89-host\") pod \"node-ca-p8xlt\" (UID: \"08b33c6b-c74d-4666-a461-47432d836c89\") " pod="openshift-image-registry/node-ca-p8xlt"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4aad42e4-7f0c-474b-97a4-4ae36af5637f-iptables-alerter-script\") pod \"iptables-alerter-4wwss\" (UID: \"4aad42e4-7f0c-474b-97a4-4ae36af5637f\") " pod="openshift-network-operator/iptables-alerter-4wwss"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904761    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-run-k8s-cni-cncf-io\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-system-cni-dir\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aad42e4-7f0c-474b-97a4-4ae36af5637f-host-slash\") pod \"iptables-alerter-4wwss\" (UID: \"4aad42e4-7f0c-474b-97a4-4ae36af5637f\") " pod="openshift-network-operator/iptables-alerter-4wwss"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904823    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-system-cni-dir\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-multus-socket-dir-parent\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904865    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aad42e4-7f0c-474b-97a4-4ae36af5637f-host-slash\") pod \"iptables-alerter-4wwss\" (UID: \"4aad42e4-7f0c-474b-97a4-4ae36af5637f\") " pod="openshift-network-operator/iptables-alerter-4wwss"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904865    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-run-netns\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-var-lib-kubelet\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-multus-socket-dir-parent\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-run-netns\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f46d7a90-17ca-474d-8c35-e44e1e222184-cni-binary-copy\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904929    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-var-lib-kubelet\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-run-multus-certs\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.904974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23ac8fbb-a563-481d-87cc-49188ab19fc4-kubelet-config\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:18.905240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vhs\" (UniqueName: \"kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs\") pod \"network-check-target-2d9kz\" (UID: \"5f63c403-8578-484c-a608-54939ba529d6\") " pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-multus-cni-dir\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-host-run-multus-certs\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1a7f988-c495-4a1a-a6d6-372164fd830b-hosts-file\") pod \"node-resolver-gpsp2\" (UID: \"d1a7f988-c495-4a1a-a6d6-372164fd830b\") " pod="openshift-dns/node-resolver-gpsp2"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905094    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1a7f988-c495-4a1a-a6d6-372164fd830b-hosts-file\") pod \"node-resolver-gpsp2\" (UID: \"d1a7f988-c495-4a1a-a6d6-372164fd830b\") " pod="openshift-dns/node-resolver-gpsp2"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905098    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f46d7a90-17ca-474d-8c35-e44e1e222184-multus-daemon-config\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krsw5\" (UniqueName: \"kubernetes.io/projected/d1a7f988-c495-4a1a-a6d6-372164fd830b-kube-api-access-krsw5\") pod \"node-resolver-gpsp2\" (UID: \"d1a7f988-c495-4a1a-a6d6-372164fd830b\") " pod="openshift-dns/node-resolver-gpsp2"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23ac8fbb-a563-481d-87cc-49188ab19fc4-dbus\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-hostroot\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-multus-cni-dir\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08b33c6b-c74d-4666-a461-47432d836c89-serviceca\") pod \"node-ca-p8xlt\" (UID: \"08b33c6b-c74d-4666-a461-47432d836c89\") " pod="openshift-image-registry/node-ca-p8xlt"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905067    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23ac8fbb-a563-481d-87cc-49188ab19fc4-kubelet-config\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4aad42e4-7f0c-474b-97a4-4ae36af5637f-iptables-alerter-script\") pod \"iptables-alerter-4wwss\" (UID: \"4aad42e4-7f0c-474b-97a4-4ae36af5637f\") " pod="openshift-network-operator/iptables-alerter-4wwss"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-etc-kubernetes\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23ac8fbb-a563-481d-87cc-49188ab19fc4-dbus\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w72wj\" (UniqueName: \"kubernetes.io/projected/08b33c6b-c74d-4666-a461-47432d836c89-kube-api-access-w72wj\") pod \"node-ca-p8xlt\" (UID: \"08b33c6b-c74d-4666-a461-47432d836c89\") " pod="openshift-image-registry/node-ca-p8xlt"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905318    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-hostroot\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.906045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905355    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f46d7a90-17ca-474d-8c35-e44e1e222184-etc-kubernetes\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.906826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905401    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f46d7a90-17ca-474d-8c35-e44e1e222184-cni-binary-copy\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.906826 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:18.905404    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:18.906826 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:18.905475    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs podName:9482820b-d3b9-4d4e-b538-6c33fcbf5312 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:19.405461878 +0000 UTC m=+3.260606740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs") pod "network-metrics-daemon-b86vq" (UID: "9482820b-d3b9-4d4e-b538-6c33fcbf5312") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:18.906826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.905692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08b33c6b-c74d-4666-a461-47432d836c89-serviceca\") pod \"node-ca-p8xlt\" (UID: \"08b33c6b-c74d-4666-a461-47432d836c89\") " pod="openshift-image-registry/node-ca-p8xlt"
Jul 13 21:09:18.913458 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:18.913304    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:09:18.913458 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:18.913331    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:09:18.913458 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:18.913345    2580 projected.go:196] Error preparing data for projected volume kube-api-access-d6vhs for pod openshift-network-diagnostics/network-check-target-2d9kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:18.913458 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:18.913415    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs podName:5f63c403-8578-484c-a608-54939ba529d6 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:19.413398491 +0000 UTC m=+3.268543368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d6vhs" (UniqueName: "kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs") pod "network-check-target-2d9kz" (UID: "5f63c403-8578-484c-a608-54939ba529d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:18.915639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.915615    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q29ts\" (UniqueName: \"kubernetes.io/projected/4aad42e4-7f0c-474b-97a4-4ae36af5637f-kube-api-access-q29ts\") pod \"iptables-alerter-4wwss\" (UID: \"4aad42e4-7f0c-474b-97a4-4ae36af5637f\") " pod="openshift-network-operator/iptables-alerter-4wwss"
Jul 13 21:09:18.915639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.915635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md6qv\" (UniqueName: \"kubernetes.io/projected/9482820b-d3b9-4d4e-b538-6c33fcbf5312-kube-api-access-md6qv\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:18.915809 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.915781    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krsw5\" (UniqueName: \"kubernetes.io/projected/d1a7f988-c495-4a1a-a6d6-372164fd830b-kube-api-access-krsw5\") pod \"node-resolver-gpsp2\" (UID: \"d1a7f988-c495-4a1a-a6d6-372164fd830b\") " pod="openshift-dns/node-resolver-gpsp2"
Jul 13 21:09:18.916404 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.916347    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w72wj\" (UniqueName: \"kubernetes.io/projected/08b33c6b-c74d-4666-a461-47432d836c89-kube-api-access-w72wj\") pod \"node-ca-p8xlt\" (UID: \"08b33c6b-c74d-4666-a461-47432d836c89\") " pod="openshift-image-registry/node-ca-p8xlt"
Jul 13 21:09:18.916619 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.916602    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qttjp\" (UniqueName: \"kubernetes.io/projected/f46d7a90-17ca-474d-8c35-e44e1e222184-kube-api-access-qttjp\") pod \"multus-67xqp\" (UID: \"f46d7a90-17ca-474d-8c35-e44e1e222184\") " pod="openshift-multus/multus-67xqp"
Jul 13 21:09:18.976154 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.976132    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xs8jp"
Jul 13 21:09:18.978309 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.978286    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-clhj6"
Jul 13 21:09:18.988046 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.988026    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:18.994895 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:18.994880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kbwt7"
Jul 13 21:09:18.998825 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:18.998800    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342572ad_5e24_4e80_88ae_7adbfeb3764b.slice/crio-6f5cd9fb4a19a8c87147bb461d0da3a34b5bdad0fbf72380cf04014e76549be2 WatchSource:0}: Error finding container 6f5cd9fb4a19a8c87147bb461d0da3a34b5bdad0fbf72380cf04014e76549be2: Status 404 returned error can't find the container with id 6f5cd9fb4a19a8c87147bb461d0da3a34b5bdad0fbf72380cf04014e76549be2
Jul 13 21:09:19.001792 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.001774    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs"
Jul 13 21:09:19.004657 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:19.004637    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1297c7_117c_42c9_82f6_9e3aaaa78311.slice/crio-74028587e39a1877e4651179da3f0d3b71b04657b700d7bd59aa68bbfe05efaf WatchSource:0}: Error finding container 74028587e39a1877e4651179da3f0d3b71b04657b700d7bd59aa68bbfe05efaf: Status 404 returned error can't find the container with id 74028587e39a1877e4651179da3f0d3b71b04657b700d7bd59aa68bbfe05efaf
Jul 13 21:09:19.009010 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.008977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-67xqp"
Jul 13 21:09:19.012702 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:19.012677    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7dc5d7b_98ef_4f09_bc4c_adabfc33b356.slice/crio-a71ab48220e3b05db9d7be74cbca5a114d6962b524674463b82317424c9ef66f WatchSource:0}: Error finding container a71ab48220e3b05db9d7be74cbca5a114d6962b524674463b82317424c9ef66f: Status 404 returned error can't find the container with id a71ab48220e3b05db9d7be74cbca5a114d6962b524674463b82317424c9ef66f
Jul 13 21:09:19.015121 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.015037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gpsp2"
Jul 13 21:09:19.019112 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:19.019087    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46d7a90_17ca_474d_8c35_e44e1e222184.slice/crio-83db4f5fe65826cb5dbcf1ed4bceec6c01c36dba6f17216f696725d54d7ed35b WatchSource:0}: Error finding container 83db4f5fe65826cb5dbcf1ed4bceec6c01c36dba6f17216f696725d54d7ed35b: Status 404 returned error can't find the container with id 83db4f5fe65826cb5dbcf1ed4bceec6c01c36dba6f17216f696725d54d7ed35b
Jul 13 21:09:19.022765 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.022745    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p8xlt"
Jul 13 21:09:19.024237 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:19.024211    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a7f988_c495_4a1a_a6d6_372164fd830b.slice/crio-aa5c8c3822289439b8774f274d2c97f9036447846997454a9199c986475a5453 WatchSource:0}: Error finding container aa5c8c3822289439b8774f274d2c97f9036447846997454a9199c986475a5453: Status 404 returned error can't find the container with id aa5c8c3822289439b8774f274d2c97f9036447846997454a9199c986475a5453
Jul 13 21:09:19.027531 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.027512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4wwss"
Jul 13 21:09:19.032484 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:19.032465    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b33c6b_c74d_4666_a461_47432d836c89.slice/crio-529f39c66becde8952b896d8a0b58989cda6dff50842499c19b3bc15e6b27176 WatchSource:0}: Error finding container 529f39c66becde8952b896d8a0b58989cda6dff50842499c19b3bc15e6b27176: Status 404 returned error can't find the container with id 529f39c66becde8952b896d8a0b58989cda6dff50842499c19b3bc15e6b27176
Jul 13 21:09:19.037084 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:19.037065    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aad42e4_7f0c_474b_97a4_4ae36af5637f.slice/crio-96da560906a296cc1adcea1a850ba441e8c6d40378325e2e64d7bd7bc0bcf10d WatchSource:0}: Error finding container 96da560906a296cc1adcea1a850ba441e8c6d40378325e2e64d7bd7bc0bcf10d: Status 404 returned error can't find the container with id 96da560906a296cc1adcea1a850ba441e8c6d40378325e2e64d7bd7bc0bcf10d
Jul 13 21:09:19.408661 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.408626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:19.408840 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.408702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:19.408840 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:19.408787    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:19.408840 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:19.408810    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:19.408990 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:19.408860    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret podName:23ac8fbb-a563-481d-87cc-49188ab19fc4 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:20.408841072 +0000 UTC m=+4.263985935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret") pod "global-pull-secret-syncer-2b859" (UID: "23ac8fbb-a563-481d-87cc-49188ab19fc4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:19.408990 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:19.408877    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs podName:9482820b-d3b9-4d4e-b538-6c33fcbf5312 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:20.408870034 +0000 UTC m=+4.264014897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs") pod "network-metrics-daemon-b86vq" (UID: "9482820b-d3b9-4d4e-b538-6c33fcbf5312") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:19.509135 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.509103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vhs\" (UniqueName: \"kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs\") pod \"network-check-target-2d9kz\" (UID: \"5f63c403-8578-484c-a608-54939ba529d6\") " pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:19.509359 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:19.509338    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:09:19.509456 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:19.509367    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:09:19.509456 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:19.509395    2580 projected.go:196] Error preparing data for projected volume kube-api-access-d6vhs for pod openshift-network-diagnostics/network-check-target-2d9kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:19.509556 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:19.509467    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs podName:5f63c403-8578-484c-a608-54939ba529d6 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:20.509446509 +0000 UTC m=+4.364591370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d6vhs" (UniqueName: "kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs") pod "network-check-target-2d9kz" (UID: "5f63c403-8578-484c-a608-54939ba529d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:19.683630 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.683462    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 21:04:18 +0000 UTC" deadline="2028-03-02 10:37:19.530469654 +0000 UTC"
Jul 13 21:09:19.683630 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.683521    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14341h27m59.846952149s"
Jul 13 21:09:19.717688 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.717649    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p8xlt" event={"ID":"08b33c6b-c74d-4666-a461-47432d836c89","Type":"ContainerStarted","Data":"529f39c66becde8952b896d8a0b58989cda6dff50842499c19b3bc15e6b27176"}
Jul 13 21:09:19.719590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.719543    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gpsp2" event={"ID":"d1a7f988-c495-4a1a-a6d6-372164fd830b","Type":"ContainerStarted","Data":"aa5c8c3822289439b8774f274d2c97f9036447846997454a9199c986475a5453"}
Jul 13 21:09:19.722161 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.722136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-67xqp" event={"ID":"f46d7a90-17ca-474d-8c35-e44e1e222184","Type":"ContainerStarted","Data":"83db4f5fe65826cb5dbcf1ed4bceec6c01c36dba6f17216f696725d54d7ed35b"}
Jul 13 21:09:19.725179 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.725154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs" event={"ID":"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356","Type":"ContainerStarted","Data":"a71ab48220e3b05db9d7be74cbca5a114d6962b524674463b82317424c9ef66f"}
Jul 13 21:09:19.726822 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.726801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn" event={"ID":"342572ad-5e24-4e80-88ae-7adbfeb3764b","Type":"ContainerStarted","Data":"6f5cd9fb4a19a8c87147bb461d0da3a34b5bdad0fbf72380cf04014e76549be2"}
Jul 13 21:09:19.729285 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.729262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clhj6" event={"ID":"19344c9e-fc2c-4cb5-84de-2f024b60eabf","Type":"ContainerStarted","Data":"b5c83bfd6cf35dd7e9d1971850322093a799f64197d1d92c5cb00a5391b5f745"}
Jul 13 21:09:19.731154 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.731130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4wwss" event={"ID":"4aad42e4-7f0c-474b-97a4-4ae36af5637f","Type":"ContainerStarted","Data":"96da560906a296cc1adcea1a850ba441e8c6d40378325e2e64d7bd7bc0bcf10d"}
Jul 13 21:09:19.732842 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.732814    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kbwt7" event={"ID":"4e1297c7-117c-42c9-82f6-9e3aaaa78311","Type":"ContainerStarted","Data":"74028587e39a1877e4651179da3f0d3b71b04657b700d7bd59aa68bbfe05efaf"}
Jul 13 21:09:19.734334 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:19.734312    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xs8jp" event={"ID":"662201cc-a8f3-42cc-8ce1-1f9d7d2867bd","Type":"ContainerStarted","Data":"8c2e3ce7d65a14c0cd5cbfe63a47339d2e413f28ec1c275bb9a3e18c0c71cc76"}
Jul 13 21:09:20.416993 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:20.416899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:20.416993 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:20.416989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:20.417205 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:20.417107    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:20.417205 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:20.417156    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs podName:9482820b-d3b9-4d4e-b538-6c33fcbf5312 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:22.417142862 +0000 UTC m=+6.272287723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs") pod "network-metrics-daemon-b86vq" (UID: "9482820b-d3b9-4d4e-b538-6c33fcbf5312") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:20.417579 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:20.417558    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:20.417663 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:20.417622    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret podName:23ac8fbb-a563-481d-87cc-49188ab19fc4 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:22.417605105 +0000 UTC m=+6.272749988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret") pod "global-pull-secret-syncer-2b859" (UID: "23ac8fbb-a563-481d-87cc-49188ab19fc4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:20.518328 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:20.518280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vhs\" (UniqueName: \"kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs\") pod \"network-check-target-2d9kz\" (UID: \"5f63c403-8578-484c-a608-54939ba529d6\") " pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:20.518504 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:20.518467    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:09:20.518504 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:20.518490    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:09:20.518504 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:20.518502    2580 projected.go:196] Error preparing data for projected volume kube-api-access-d6vhs for pod openshift-network-diagnostics/network-check-target-2d9kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:20.518703 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:20.518558    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs podName:5f63c403-8578-484c-a608-54939ba529d6 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:22.518540701 +0000 UTC m=+6.373685585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d6vhs" (UniqueName: "kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs") pod "network-check-target-2d9kz" (UID: "5f63c403-8578-484c-a608-54939ba529d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:20.684624 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:20.684519    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 21:04:18 +0000 UTC" deadline="2028-01-06 13:52:19.457209522 +0000 UTC"
Jul 13 21:09:20.684624 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:20.684577    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13000h42m58.772637491s"
Jul 13 21:09:20.710057 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:20.710027    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:20.710215 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:20.710177    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:20.710621 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:20.710600    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:20.710736 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:20.710713    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:20.710805 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:20.710778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:20.710859 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:20.710847    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:20.755645 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:20.755608    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" event={"ID":"1d094537333ce6cfa1746d8c5a70fd11","Type":"ContainerStarted","Data":"99285e5860c50c4518bfe51d9ff31431a410213fd746d398473b7349a9866c7c"}
Jul 13 21:09:22.434685 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:22.433919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:22.434685 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:22.433991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:22.434685 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:22.434135    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:22.434685 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:22.434196    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret podName:23ac8fbb-a563-481d-87cc-49188ab19fc4 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:26.434177862 +0000 UTC m=+10.289322729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret") pod "global-pull-secret-syncer-2b859" (UID: "23ac8fbb-a563-481d-87cc-49188ab19fc4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:22.434685 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:22.434589    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:22.434685 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:22.434639    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs podName:9482820b-d3b9-4d4e-b538-6c33fcbf5312 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:26.434622668 +0000 UTC m=+10.289767528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs") pod "network-metrics-daemon-b86vq" (UID: "9482820b-d3b9-4d4e-b538-6c33fcbf5312") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:22.535830 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:22.535121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vhs\" (UniqueName: \"kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs\") pod \"network-check-target-2d9kz\" (UID: \"5f63c403-8578-484c-a608-54939ba529d6\") " pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:22.535830 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:22.535335    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:09:22.535830 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:22.535357    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:09:22.535830 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:22.535394    2580 projected.go:196] Error preparing data for projected volume kube-api-access-d6vhs for pod openshift-network-diagnostics/network-check-target-2d9kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:22.535830 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:22.535454    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs podName:5f63c403-8578-484c-a608-54939ba529d6 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:26.53543499 +0000 UTC m=+10.390579864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d6vhs" (UniqueName: "kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs") pod "network-check-target-2d9kz" (UID: "5f63c403-8578-484c-a608-54939ba529d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:22.709007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:22.708930    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:22.709131 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:22.709081    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:22.709516 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:22.709485    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:22.709599 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:22.709575    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:22.709654 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:22.709596    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:22.709702 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:22.709670    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:24.707919 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:24.707882    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:24.708408 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:24.707882    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:24.708408 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:24.708013    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:24.708408 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:24.708095    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:24.708408 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:24.707883    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:24.708408 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:24.708220    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:26.469829 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:26.469789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:26.470282 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:26.469851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:26.470282 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:26.469949    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:26.470282 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:26.469983    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:26.470282 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:26.470042    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs podName:9482820b-d3b9-4d4e-b538-6c33fcbf5312 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:34.470020594 +0000 UTC m=+18.325165454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs") pod "network-metrics-daemon-b86vq" (UID: "9482820b-d3b9-4d4e-b538-6c33fcbf5312") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:26.470282 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:26.470063    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret podName:23ac8fbb-a563-481d-87cc-49188ab19fc4 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:34.470052493 +0000 UTC m=+18.325197355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret") pod "global-pull-secret-syncer-2b859" (UID: "23ac8fbb-a563-481d-87cc-49188ab19fc4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:26.570973 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:26.570936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vhs\" (UniqueName: \"kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs\") pod \"network-check-target-2d9kz\" (UID: \"5f63c403-8578-484c-a608-54939ba529d6\") " pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:26.571162 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:26.571130    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:09:26.571162 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:26.571157    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:09:26.571286 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:26.571170    2580 projected.go:196] Error preparing data for projected volume kube-api-access-d6vhs for pod openshift-network-diagnostics/network-check-target-2d9kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:26.571286 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:26.571232    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs podName:5f63c403-8578-484c-a608-54939ba529d6 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:34.571212539 +0000 UTC m=+18.426357420 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d6vhs" (UniqueName: "kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs") pod "network-check-target-2d9kz" (UID: "5f63c403-8578-484c-a608-54939ba529d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:26.708393 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:26.708345    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:26.708552 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:26.708498    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:26.708897 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:26.708876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:26.709006 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:26.708987    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:26.709137 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:26.709123    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:26.710055 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:26.710025    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:28.708896 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:28.708238    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:28.708896 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:28.708366    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:28.708896 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:28.708744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:28.708896 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:28.708846    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:28.709696 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:28.709560    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:28.709696 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:28.709662    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:30.707972 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:30.707933    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:30.707972 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:30.707977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:30.708519 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:30.707933    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:30.708519 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:30.708067    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:30.708519 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:30.708178    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:30.708519 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:30.708259    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:32.708595 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:32.708555    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:32.708595 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:32.708595    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:32.709063 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:32.708573    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:32.709063 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:32.708699    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:32.709063 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:32.708767    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:32.709063 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:32.708857    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:34.530366 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:34.530326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:34.530877 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:34.530418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:34.530877 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:34.530485    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:34.530877 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:34.530506    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:34.530877 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:34.530562    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs podName:9482820b-d3b9-4d4e-b538-6c33fcbf5312 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:50.530543591 +0000 UTC m=+34.385688453 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs") pod "network-metrics-daemon-b86vq" (UID: "9482820b-d3b9-4d4e-b538-6c33fcbf5312") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:34.530877 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:34.530583    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret podName:23ac8fbb-a563-481d-87cc-49188ab19fc4 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:50.530573666 +0000 UTC m=+34.385718528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret") pod "global-pull-secret-syncer-2b859" (UID: "23ac8fbb-a563-481d-87cc-49188ab19fc4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:34.631331 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:34.631289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vhs\" (UniqueName: \"kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs\") pod \"network-check-target-2d9kz\" (UID: \"5f63c403-8578-484c-a608-54939ba529d6\") " pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:34.631528 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:34.631443    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:09:34.631528 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:34.631462    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:09:34.631528 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:34.631476    2580 projected.go:196] Error preparing data for projected volume kube-api-access-d6vhs for pod openshift-network-diagnostics/network-check-target-2d9kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:34.631682 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:34.631536    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs podName:5f63c403-8578-484c-a608-54939ba529d6 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:50.631522928 +0000 UTC m=+34.486667787 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d6vhs" (UniqueName: "kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs") pod "network-check-target-2d9kz" (UID: "5f63c403-8578-484c-a608-54939ba529d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:34.709105 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:34.708769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:34.709105 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:34.708790    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:34.709105 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:34.708782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:34.709105 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:34.708906    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:34.709105 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:34.709027    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:34.709105 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:34.709109    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:36.709001 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:36.708973    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:36.709001 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:36.708999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:36.709423 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:36.709067    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:36.709423 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:36.709159    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:36.709423 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:36.709222    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:36.709423 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:36.709307    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:38.708479 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:38.708452    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:38.708778 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:38.708584    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:38.708778 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:38.708610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:38.708778 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:38.708724    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:38.708778 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:38.708776    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:38.708975 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:38.708855    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:38.801071 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:38.800985    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-67xqp" event={"ID":"f46d7a90-17ca-474d-8c35-e44e1e222184","Type":"ContainerStarted","Data":"b4d04aca75da9f948856505f0f91bd438a08b6e6be1d45ff4bca57dc0bb205e8"}
Jul 13 21:09:38.802432 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:38.802405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kbwt7" event={"ID":"4e1297c7-117c-42c9-82f6-9e3aaaa78311","Type":"ContainerStarted","Data":"df7986653e5fe1d6a879982f93cedcc6f5d5f1af0eb57b7938d1533851db44fa"}
Jul 13 21:09:38.819584 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:38.819235    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" podStartSLOduration=20.819216249 podStartE2EDuration="20.819216249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:20.770235715 +0000 UTC m=+4.625380598" watchObservedRunningTime="2026-07-13 21:09:38.819216249 +0000 UTC m=+22.674361133"
Jul 13 21:09:38.819743 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:38.819571    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-67xqp" podStartSLOduration=3.3718285630000002 podStartE2EDuration="22.819560377s" totalImagesPullingTime="19.447731814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:38.818940447 +0000 UTC m=+22.674085329" watchObservedRunningTime="2026-07-13 21:09:38.819560377 +0000 UTC m=+22.674705260"
Jul 13 21:09:39.807694 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.807233    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p8xlt" event={"ID":"08b33c6b-c74d-4666-a461-47432d836c89","Type":"ContainerStarted","Data":"1936aad5e91754bd3fa4b03cd0c4446e983e6f6cea708d97bd822bfceff22107"}
Jul 13 21:09:39.808973 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.808943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gpsp2" event={"ID":"d1a7f988-c495-4a1a-a6d6-372164fd830b","Type":"ContainerStarted","Data":"73b9bbc0c6f2f6d8d7206a1ed31d03b82f50d33dcb247013596e431ccbdf28c1"}
Jul 13 21:09:39.810587 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.810564    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs" event={"ID":"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356","Type":"ContainerStarted","Data":"03e0418ceccb70daaa99a1bfa0a67238c4a44a87649037ed9099ff0d49650e9c"}
Jul 13 21:09:39.813756 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.813734    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:09:39.814126 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.814100    2580 generic.go:356] "Generic (PLEG): container finished" podID="342572ad-5e24-4e80-88ae-7adbfeb3764b" containerID="ccb8b0be2795e09e0341ae064942cfd84bca4b9bbd189f9d88941ed367d680b1" exitCode=1
Jul 13 21:09:39.814238 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.814164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn" event={"ID":"342572ad-5e24-4e80-88ae-7adbfeb3764b","Type":"ContainerStarted","Data":"93a27ee6ae6ca9dc958462f4321f32e30364b4d499f8602139b6bbf91adb7eff"}
Jul 13 21:09:39.814298 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.814237    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn" event={"ID":"342572ad-5e24-4e80-88ae-7adbfeb3764b","Type":"ContainerStarted","Data":"d216f3244f12a021202657b40b595e8d6328951b41ee13ee7c3b4ba3235ccf31"}
Jul 13 21:09:39.814298 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.814290    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn" event={"ID":"342572ad-5e24-4e80-88ae-7adbfeb3764b","Type":"ContainerStarted","Data":"8195b79b8abdba865786f9e3e1832c2efefbd3a02bb982769e86fbfe9edd09cd"}
Jul 13 21:09:39.814445 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.814340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn" event={"ID":"342572ad-5e24-4e80-88ae-7adbfeb3764b","Type":"ContainerStarted","Data":"245d023f5424b8b984772104e14a330f277a9d3dc0e9cb4bd4fdcd16bcfec11a"}
Jul 13 21:09:39.814445 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.814371    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn" event={"ID":"342572ad-5e24-4e80-88ae-7adbfeb3764b","Type":"ContainerDied","Data":"ccb8b0be2795e09e0341ae064942cfd84bca4b9bbd189f9d88941ed367d680b1"}
Jul 13 21:09:39.814555 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.814503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn" event={"ID":"342572ad-5e24-4e80-88ae-7adbfeb3764b","Type":"ContainerStarted","Data":"0f4b33fdefd7f392abf036b53f61806cc70269e300310e299406e084bc708a07"}
Jul 13 21:09:39.816105 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.816015    2580 generic.go:356] "Generic (PLEG): container finished" podID="19344c9e-fc2c-4cb5-84de-2f024b60eabf" containerID="005a05c222ac3fd39be4c6144830e467733b1062cd7c4dd09fbcf98fa7086eab" exitCode=0
Jul 13 21:09:39.816105 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.816097    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clhj6" event={"ID":"19344c9e-fc2c-4cb5-84de-2f024b60eabf","Type":"ContainerDied","Data":"005a05c222ac3fd39be4c6144830e467733b1062cd7c4dd09fbcf98fa7086eab"}
Jul 13 21:09:39.817862 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.817805    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xs8jp" event={"ID":"662201cc-a8f3-42cc-8ce1-1f9d7d2867bd","Type":"ContainerStarted","Data":"06aebcbe19e276febbcababda93cff61ac8cf84d79cd054649609da41011c3d8"}
Jul 13 21:09:39.820372 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.820343    2580 generic.go:356] "Generic (PLEG): container finished" podID="69112e71603383d0f97eae91b3fd05e2" containerID="7ff6bda038a8315ee71104bfa9162fd050a1c4bb2fa8f55660c74c0e20177099" exitCode=0
Jul 13 21:09:39.820743 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.820663    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kbwt7" podStartSLOduration=4.370731066 podStartE2EDuration="23.820644629s" totalImagesPullingTime="19.449913563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:38.834945554 +0000 UTC m=+22.690090435" watchObservedRunningTime="2026-07-13 21:09:39.820644629 +0000 UTC m=+23.675789512"
Jul 13 21:09:39.821348 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.821247    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" event={"ID":"69112e71603383d0f97eae91b3fd05e2","Type":"ContainerDied","Data":"7ff6bda038a8315ee71104bfa9162fd050a1c4bb2fa8f55660c74c0e20177099"}
Jul 13 21:09:39.834695 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.834643    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gpsp2" podStartSLOduration=4.404822498 podStartE2EDuration="23.834623092s" totalImagesPullingTime="19.429800594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:39.834036306 +0000 UTC m=+23.689181192" watchObservedRunningTime="2026-07-13 21:09:39.834623092 +0000 UTC m=+23.689767977"
Jul 13 21:09:39.834823 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.834744    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p8xlt" podStartSLOduration=4.413123853 podStartE2EDuration="23.834735467s" totalImagesPullingTime="19.421611614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:39.82160494 +0000 UTC m=+23.676749823" watchObservedRunningTime="2026-07-13 21:09:39.834735467 +0000 UTC m=+23.689880352"
Jul 13 21:09:39.879562 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:39.879505    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xs8jp" podStartSLOduration=4.418732829 podStartE2EDuration="23.879488449s" totalImagesPullingTime="19.46075562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:39.878683194 +0000 UTC m=+23.733828078" watchObservedRunningTime="2026-07-13 21:09:39.879488449 +0000 UTC m=+23.734633330"
Jul 13 21:09:40.620802 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:40.620771    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 21:09:40.673793 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:40.673664    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T21:09:40.620796389Z","UUID":"fa10e852-71bc-4198-8c65-9f4ca1737c89","Handler":null,"Name":"","Endpoint":""}
Jul 13 21:09:40.675215 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:40.675190    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 21:09:40.675348 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:40.675236    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 21:09:40.708578 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:40.708288    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:40.708578 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:40.708288    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:40.708578 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:40.708422    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:40.708578 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:40.708438    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:40.708578 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:40.708552    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:40.708866 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:40.708634    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:40.824538 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:40.824459    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4wwss" event={"ID":"4aad42e4-7f0c-474b-97a4-4ae36af5637f","Type":"ContainerStarted","Data":"1eb5fd1dffa638642313f34eb12f5ed648c78af1ef213c53f0c23d372ba4e9a8"}
Jul 13 21:09:40.826667 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:40.826639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" event={"ID":"69112e71603383d0f97eae91b3fd05e2","Type":"ContainerStarted","Data":"d2ecfe7516a016886c0e4d908f45cb1547a1e67496619d1d9989d8589faea415"}
Jul 13 21:09:40.828902 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:40.828855    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs" event={"ID":"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356","Type":"ContainerStarted","Data":"1010097e574e661300372ef95300c1a162f8a1d8677ec325f1c41b4a887f1ed8"}
Jul 13 21:09:40.849867 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:40.849824    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4wwss" podStartSLOduration=5.433093305 podStartE2EDuration="24.849807427s" totalImagesPullingTime="19.416714122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:40.837129824 +0000 UTC m=+24.692274706" watchObservedRunningTime="2026-07-13 21:09:40.849807427 +0000 UTC m=+24.704952309"
Jul 13 21:09:40.850314 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:40.850285    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" podStartSLOduration=22.850273102 podStartE2EDuration="22.850273102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:40.849946688 +0000 UTC m=+24.705091561" watchObservedRunningTime="2026-07-13 21:09:40.850273102 +0000 UTC m=+24.705417986"
Jul 13 21:09:41.601782 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:41.601745    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xs8jp"
Jul 13 21:09:41.602332 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:41.602313    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xs8jp"
Jul 13 21:09:42.708074 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:42.707873    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:42.708562 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:42.707878    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:42.708562 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:42.707882    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:42.708562 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:42.708191    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:42.708562 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:42.708330    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:42.708948 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:42.708908    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:42.835815 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:42.835767    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs" event={"ID":"d7dc5d7b-98ef-4f09-bc4c-adabfc33b356","Type":"ContainerStarted","Data":"a1740fc3496f5634a14abd9666447a68aeb8238bcaf43cbfea8f7324c51936c9"}
Jul 13 21:09:42.839067 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:42.839036    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:09:42.839421 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:42.839391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn" event={"ID":"342572ad-5e24-4e80-88ae-7adbfeb3764b","Type":"ContainerStarted","Data":"7afa85a6243f7720eae84b9476972f9d4bb607d9731810913466dd47a20905c6"}
Jul 13 21:09:42.839546 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:42.839440    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 13 21:09:42.853002 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:42.852955    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xnqs" podStartSLOduration=9.373214981 podStartE2EDuration="26.85294247s" totalImagesPullingTime="17.479727489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:42.852723446 +0000 UTC m=+26.707868329" watchObservedRunningTime="2026-07-13 21:09:42.85294247 +0000 UTC m=+26.708087351"
Jul 13 21:09:43.210807 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:43.210774    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xs8jp"
Jul 13 21:09:43.211461 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:43.211434    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xs8jp"
Jul 13 21:09:44.708681 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:44.708648    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:44.709489 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:44.708656    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:44.709489 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:44.708769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:44.709489 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:44.708769    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:44.709489 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:44.708849    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:44.709489 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:44.708919    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:44.847721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:44.847686    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:09:44.848091 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:44.848061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn" event={"ID":"342572ad-5e24-4e80-88ae-7adbfeb3764b","Type":"ContainerStarted","Data":"f7075b1c643f57a355215bb41a96cc78f192e426e5adddef9cd68595fa64f5da"}
Jul 13 21:09:44.848347 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:44.848324    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:44.848569 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:44.848521    2580 scope.go:117] "RemoveContainer" containerID="ccb8b0be2795e09e0341ae064942cfd84bca4b9bbd189f9d88941ed367d680b1"
Jul 13 21:09:44.850177 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:44.850152    2580 generic.go:356] "Generic (PLEG): container finished" podID="19344c9e-fc2c-4cb5-84de-2f024b60eabf" containerID="33a327d5292241a131af585441a79db9eb9d2dbd1b2a5443dacf1bd5916da2dc" exitCode=0
Jul 13 21:09:44.850301 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:44.850200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clhj6" event={"ID":"19344c9e-fc2c-4cb5-84de-2f024b60eabf","Type":"ContainerDied","Data":"33a327d5292241a131af585441a79db9eb9d2dbd1b2a5443dacf1bd5916da2dc"}
Jul 13 21:09:44.866466 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:44.866446    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:45.857983 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:45.857947    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:09:45.858595 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:45.858292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn" event={"ID":"342572ad-5e24-4e80-88ae-7adbfeb3764b","Type":"ContainerStarted","Data":"e00282e365798c0180ad257a110dc4830513efb43ac213e445d89e1cb8781a2d"}
Jul 13 21:09:45.858677 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:45.858622    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:45.858741 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:45.858682    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:45.873305 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:45.873278    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:09:45.884810 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:45.884765    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn" podStartSLOduration=9.958062473 podStartE2EDuration="29.884750326s" totalImagesPullingTime="19.926687853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:45.883804179 +0000 UTC m=+29.738949061" watchObservedRunningTime="2026-07-13 21:09:45.884750326 +0000 UTC m=+29.739895207"
Jul 13 21:09:46.161376 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:46.161141    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2b859"]
Jul 13 21:09:46.161548 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:46.161444    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:46.161607 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:46.161539    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:46.161724 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:46.161703    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2d9kz"]
Jul 13 21:09:46.161796 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:46.161786    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:46.161873 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:46.161858    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:46.163226 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:46.163199    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b86vq"]
Jul 13 21:09:46.163337 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:46.163291    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:46.163406 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:46.163358    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:46.862368 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:46.862329    2580 generic.go:356] "Generic (PLEG): container finished" podID="19344c9e-fc2c-4cb5-84de-2f024b60eabf" containerID="b65a6880d845019912f3db67e8caa2a86e071133fd57f0cb106013519c871ca3" exitCode=0
Jul 13 21:09:46.862765 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:46.862421    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clhj6" event={"ID":"19344c9e-fc2c-4cb5-84de-2f024b60eabf","Type":"ContainerDied","Data":"b65a6880d845019912f3db67e8caa2a86e071133fd57f0cb106013519c871ca3"}
Jul 13 21:09:47.707865 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:47.707834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:47.708044 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:47.707834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:47.708044 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:47.707937    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:47.708044 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:47.707834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:47.708044 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:47.707998    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:47.708199 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:47.708056    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:48.868711 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:48.868677    2580 generic.go:356] "Generic (PLEG): container finished" podID="19344c9e-fc2c-4cb5-84de-2f024b60eabf" containerID="f1027d86b4cad4dd06fddbda8212f330c906521d96a9a9a266bb750b87f4486b" exitCode=0
Jul 13 21:09:48.869294 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:48.868742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clhj6" event={"ID":"19344c9e-fc2c-4cb5-84de-2f024b60eabf","Type":"ContainerDied","Data":"f1027d86b4cad4dd06fddbda8212f330c906521d96a9a9a266bb750b87f4486b"}
Jul 13 21:09:49.708390 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:49.708346    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:49.708390 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:49.708394    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:49.708583 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:49.708345    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:49.708583 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:49.708459    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b859" podUID="23ac8fbb-a563-481d-87cc-49188ab19fc4"
Jul 13 21:09:49.708583 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:49.708565    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2d9kz" podUID="5f63c403-8578-484c-a608-54939ba529d6"
Jul 13 21:09:49.708705 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:49.708629    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b86vq" podUID="9482820b-d3b9-4d4e-b538-6c33fcbf5312"
Jul 13 21:09:50.551178 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:50.551148    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:50.551717 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:50.551215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:50.551717 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:50.551311    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:50.551717 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:50.551364    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs podName:9482820b-d3b9-4d4e-b538-6c33fcbf5312 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:22.55134502 +0000 UTC m=+66.406489884 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs") pod "network-metrics-daemon-b86vq" (UID: "9482820b-d3b9-4d4e-b538-6c33fcbf5312") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:09:50.551717 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:50.551311    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:50.551717 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:50.551474    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret podName:23ac8fbb-a563-481d-87cc-49188ab19fc4 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:22.551452635 +0000 UTC m=+66.406597503 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret") pod "global-pull-secret-syncer-2b859" (UID: "23ac8fbb-a563-481d-87cc-49188ab19fc4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:09:50.652438 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:50.652410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vhs\" (UniqueName: \"kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs\") pod \"network-check-target-2d9kz\" (UID: \"5f63c403-8578-484c-a608-54939ba529d6\") " pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:50.652579 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:50.652533    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:09:50.652579 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:50.652549    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:09:50.652579 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:50.652558    2580 projected.go:196] Error preparing data for projected volume kube-api-access-d6vhs for pod openshift-network-diagnostics/network-check-target-2d9kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:50.652678 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:50.652601    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs podName:5f63c403-8578-484c-a608-54939ba529d6 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:22.652588473 +0000 UTC m=+66.507733333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d6vhs" (UniqueName: "kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs") pod "network-check-target-2d9kz" (UID: "5f63c403-8578-484c-a608-54939ba529d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:09:51.447986 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.447959    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeReady"
Jul 13 21:09:51.448134 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.448082    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 21:09:51.479484 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.479450    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b95f9f575-q56k9"]
Jul 13 21:09:51.481275 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.481250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.483737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.483537    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 21:09:51.483737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.483539    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 21:09:51.483737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.483606    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2l9mp\""
Jul 13 21:09:51.484409 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.484128    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 21:09:51.489992 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.489886    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wh5tq"]
Jul 13 21:09:51.490261 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.490237    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 21:09:51.492329 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.492074    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zf7m7"]
Jul 13 21:09:51.492915 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.492591    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wh5tq"
Jul 13 21:09:51.494729 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.494709    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rg67s\""
Jul 13 21:09:51.494849 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.494830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:51.495273 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.495131    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 21:09:51.495543 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.495524    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 21:09:51.495689 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.495670    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 21:09:51.496235 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.496213    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b95f9f575-q56k9"]
Jul 13 21:09:51.496756 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.496738    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 21:09:51.496988 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.496966    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqhqf\""
Jul 13 21:09:51.497238 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.497217    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 21:09:51.502910 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.502890    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wh5tq"]
Jul 13 21:09:51.505267 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.505248    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zf7m7"]
Jul 13 21:09:51.558825 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.558790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.559236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.558872    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0e84464-f726-466c-b36a-f6718a50c0a4-image-registry-private-configuration\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.559236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.558905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0e84464-f726-466c-b36a-f6718a50c0a4-ca-trust-extracted\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.559236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.558925    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-certificates\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.559236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.558942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zdrh\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-kube-api-access-2zdrh\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.559236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.558971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0e84464-f726-466c-b36a-f6718a50c0a4-trusted-ca\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.559236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.558998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpdrj\" (UniqueName: \"kubernetes.io/projected/0ac615bd-67c0-46c3-a479-9f5031782569-kube-api-access-hpdrj\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:51.559236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.559031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ac615bd-67c0-46c3-a479-9f5031782569-tmp-dir\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:51.559236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.559137    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0e84464-f726-466c-b36a-f6718a50c0a4-installation-pull-secrets\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.559236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.559171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fb02e34-7059-4d59-884f-4e9a747fef9f-cert\") pod \"ingress-canary-wh5tq\" (UID: \"2fb02e34-7059-4d59-884f-4e9a747fef9f\") " pod="openshift-ingress-canary/ingress-canary-wh5tq"
Jul 13 21:09:51.559236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.559185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-bound-sa-token\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.559236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.559198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ac615bd-67c0-46c3-a479-9f5031782569-config-volume\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:51.559236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.559213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:51.559757 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.559244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9qlj\" (UniqueName: \"kubernetes.io/projected/2fb02e34-7059-4d59-884f-4e9a747fef9f-kube-api-access-m9qlj\") pod \"ingress-canary-wh5tq\" (UID: \"2fb02e34-7059-4d59-884f-4e9a747fef9f\") " pod="openshift-ingress-canary/ingress-canary-wh5tq"
Jul 13 21:09:51.660415 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0e84464-f726-466c-b36a-f6718a50c0a4-image-registry-private-configuration\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.660594 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0e84464-f726-466c-b36a-f6718a50c0a4-ca-trust-extracted\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.660594 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-certificates\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.660594 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zdrh\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-kube-api-access-2zdrh\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.660594 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0e84464-f726-466c-b36a-f6718a50c0a4-trusted-ca\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.660594 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpdrj\" (UniqueName: \"kubernetes.io/projected/0ac615bd-67c0-46c3-a479-9f5031782569-kube-api-access-hpdrj\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:51.660594 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ac615bd-67c0-46c3-a479-9f5031782569-tmp-dir\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:51.660883 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0e84464-f726-466c-b36a-f6718a50c0a4-installation-pull-secrets\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.660883 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660641    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fb02e34-7059-4d59-884f-4e9a747fef9f-cert\") pod \"ingress-canary-wh5tq\" (UID: \"2fb02e34-7059-4d59-884f-4e9a747fef9f\") " pod="openshift-ingress-canary/ingress-canary-wh5tq"
Jul 13 21:09:51.660883 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660665    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-bound-sa-token\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.660883 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ac615bd-67c0-46c3-a479-9f5031782569-config-volume\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:51.660883 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:51.660883 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9qlj\" (UniqueName: \"kubernetes.io/projected/2fb02e34-7059-4d59-884f-4e9a747fef9f-kube-api-access-m9qlj\") pod \"ingress-canary-wh5tq\" (UID: \"2fb02e34-7059-4d59-884f-4e9a747fef9f\") " pod="openshift-ingress-canary/ingress-canary-wh5tq"
Jul 13 21:09:51.660883 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.661161 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.660917    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0e84464-f726-466c-b36a-f6718a50c0a4-ca-trust-extracted\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.661161 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:51.661011    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 21:09:51.661161 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:51.661073    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls podName:0ac615bd-67c0-46c3-a479-9f5031782569 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:52.161054134 +0000 UTC m=+36.016199000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls") pod "dns-default-zf7m7" (UID: "0ac615bd-67c0-46c3-a479-9f5031782569") : secret "dns-default-metrics-tls" not found
Jul 13 21:09:51.661618 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:51.661465    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 21:09:51.661618 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:51.661485    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b95f9f575-q56k9: secret "image-registry-tls" not found
Jul 13 21:09:51.661618 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:51.661542    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls podName:f0e84464-f726-466c-b36a-f6718a50c0a4 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:52.161524338 +0000 UTC m=+36.016669203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls") pod "image-registry-6b95f9f575-q56k9" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4") : secret "image-registry-tls" not found
Jul 13 21:09:51.661618 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.661586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-certificates\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.661891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.661807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ac615bd-67c0-46c3-a479-9f5031782569-tmp-dir\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:51.661891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.661845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0e84464-f726-466c-b36a-f6718a50c0a4-trusted-ca\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.662246 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.662225    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ac615bd-67c0-46c3-a479-9f5031782569-config-volume\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:51.665701 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.665546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0e84464-f726-466c-b36a-f6718a50c0a4-installation-pull-secrets\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.665826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.665629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fb02e34-7059-4d59-884f-4e9a747fef9f-cert\") pod \"ingress-canary-wh5tq\" (UID: \"2fb02e34-7059-4d59-884f-4e9a747fef9f\") " pod="openshift-ingress-canary/ingress-canary-wh5tq"
Jul 13 21:09:51.665826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.665629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0e84464-f726-466c-b36a-f6718a50c0a4-image-registry-private-configuration\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.669072 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.669048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-bound-sa-token\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.669194 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.669150    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpdrj\" (UniqueName: \"kubernetes.io/projected/0ac615bd-67c0-46c3-a479-9f5031782569-kube-api-access-hpdrj\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:51.669821 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.669801    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zdrh\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-kube-api-access-2zdrh\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:51.670575 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.670554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9qlj\" (UniqueName: \"kubernetes.io/projected/2fb02e34-7059-4d59-884f-4e9a747fef9f-kube-api-access-m9qlj\") pod \"ingress-canary-wh5tq\" (UID: \"2fb02e34-7059-4d59-884f-4e9a747fef9f\") " pod="openshift-ingress-canary/ingress-canary-wh5tq"
Jul 13 21:09:51.708463 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.708439    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:09:51.708573 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.708439    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:09:51.708626 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.708438    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:09:51.710933 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.710895    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 21:09:51.711217 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.711145    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gq4dz\""
Jul 13 21:09:51.711217 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.711195    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 21:09:51.711337 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.711216    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fgl7x\""
Jul 13 21:09:51.711337 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.711200    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 21:09:51.711337 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.711195    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 21:09:51.805721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.805694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wh5tq"
Jul 13 21:09:51.953104 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:51.953000    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wh5tq"]
Jul 13 21:09:51.957289 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:09:51.957261    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb02e34_7059_4d59_884f_4e9a747fef9f.slice/crio-7ee7377abc20f738b4000441f47c11ae89e71c28ec6a108591c2cbdb850d0889 WatchSource:0}: Error finding container 7ee7377abc20f738b4000441f47c11ae89e71c28ec6a108591c2cbdb850d0889: Status 404 returned error can't find the container with id 7ee7377abc20f738b4000441f47c11ae89e71c28ec6a108591c2cbdb850d0889
Jul 13 21:09:52.164684 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:52.164653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:52.164833 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:52.164708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:52.164833 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:52.164805    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 21:09:52.164905 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:52.164864    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls podName:0ac615bd-67c0-46c3-a479-9f5031782569 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:53.164848028 +0000 UTC m=+37.019992888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls") pod "dns-default-zf7m7" (UID: "0ac615bd-67c0-46c3-a479-9f5031782569") : secret "dns-default-metrics-tls" not found
Jul 13 21:09:52.164905 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:52.164813    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 21:09:52.164905 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:52.164898    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b95f9f575-q56k9: secret "image-registry-tls" not found
Jul 13 21:09:52.165006 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:52.164950    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls podName:f0e84464-f726-466c-b36a-f6718a50c0a4 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:53.16493314 +0000 UTC m=+37.020078018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls") pod "image-registry-6b95f9f575-q56k9" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4") : secret "image-registry-tls" not found
Jul 13 21:09:52.881213 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:52.881136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wh5tq" event={"ID":"2fb02e34-7059-4d59-884f-4e9a747fef9f","Type":"ContainerStarted","Data":"7ee7377abc20f738b4000441f47c11ae89e71c28ec6a108591c2cbdb850d0889"}
Jul 13 21:09:53.172033 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:53.171993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:53.172207 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:53.172080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:53.172207 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:53.172179    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 21:09:53.172320 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:53.172275    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls podName:0ac615bd-67c0-46c3-a479-9f5031782569 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:55.172251149 +0000 UTC m=+39.027396011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls") pod "dns-default-zf7m7" (UID: "0ac615bd-67c0-46c3-a479-9f5031782569") : secret "dns-default-metrics-tls" not found
Jul 13 21:09:53.172320 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:53.172283    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 21:09:53.172320 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:53.172298    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b95f9f575-q56k9: secret "image-registry-tls" not found
Jul 13 21:09:53.172505 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:53.172358    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls podName:f0e84464-f726-466c-b36a-f6718a50c0a4 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:55.172341605 +0000 UTC m=+39.027486464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls") pod "image-registry-6b95f9f575-q56k9" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4") : secret "image-registry-tls" not found
Jul 13 21:09:55.188830 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:55.188798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:55.189171 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:55.188856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:55.189171 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:55.188956    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 21:09:55.189171 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:55.188956    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 21:09:55.189171 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:55.189019    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls podName:0ac615bd-67c0-46c3-a479-9f5031782569 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:59.189003402 +0000 UTC m=+43.044148262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls") pod "dns-default-zf7m7" (UID: "0ac615bd-67c0-46c3-a479-9f5031782569") : secret "dns-default-metrics-tls" not found
Jul 13 21:09:55.189171 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:55.188967    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b95f9f575-q56k9: secret "image-registry-tls" not found
Jul 13 21:09:55.189171 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:55.189093    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls podName:f0e84464-f726-466c-b36a-f6718a50c0a4 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:59.189082225 +0000 UTC m=+43.044227084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls") pod "image-registry-6b95f9f575-q56k9" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4") : secret "image-registry-tls" not found
Jul 13 21:09:55.890520 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:55.890273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wh5tq" event={"ID":"2fb02e34-7059-4d59-884f-4e9a747fef9f","Type":"ContainerStarted","Data":"df0f62c01656ba31dda05cacb3c2bf1fd655efd7c3b14c9bc2832a384265833c"}
Jul 13 21:09:55.892852 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:55.892828    2580 generic.go:356] "Generic (PLEG): container finished" podID="19344c9e-fc2c-4cb5-84de-2f024b60eabf" containerID="b8a76fa0c751f8eb9eb3354913e98b1430ec3ecf89359e7bec6fccf76224686f" exitCode=0
Jul 13 21:09:55.892977 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:55.892865    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clhj6" event={"ID":"19344c9e-fc2c-4cb5-84de-2f024b60eabf","Type":"ContainerDied","Data":"b8a76fa0c751f8eb9eb3354913e98b1430ec3ecf89359e7bec6fccf76224686f"}
Jul 13 21:09:55.907122 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:55.905737    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wh5tq" podStartSLOduration=1.461775612 podStartE2EDuration="4.905709953s" totalImagesPullingTime="3.443934341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:55.903992235 +0000 UTC m=+39.759137118" watchObservedRunningTime="2026-07-13 21:09:55.905709953 +0000 UTC m=+39.760854836"
Jul 13 21:09:56.898621 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:56.898586    2580 generic.go:356] "Generic (PLEG): container finished" podID="19344c9e-fc2c-4cb5-84de-2f024b60eabf" containerID="044d20bb3b58e28c33d9cb3dd7006c08ed64e60bb5a47fbcc611dc2ff4b45991" exitCode=0
Jul 13 21:09:56.899200 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:56.898680    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clhj6" event={"ID":"19344c9e-fc2c-4cb5-84de-2f024b60eabf","Type":"ContainerDied","Data":"044d20bb3b58e28c33d9cb3dd7006c08ed64e60bb5a47fbcc611dc2ff4b45991"}
Jul 13 21:09:57.904692 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:57.904659    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clhj6" event={"ID":"19344c9e-fc2c-4cb5-84de-2f024b60eabf","Type":"ContainerStarted","Data":"7456cead63cb6605b951dee0c6ac62f2be8b015acfca5a14d983bdcf56103ab3"}
Jul 13 21:09:57.925119 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:57.925078    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-clhj6" podStartSLOduration=9.555804786 podStartE2EDuration="41.92506532s" totalImagesPullingTime="32.369260534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:57.925014991 +0000 UTC m=+41.780159872" watchObservedRunningTime="2026-07-13 21:09:57.92506532 +0000 UTC m=+41.780210202"
Jul 13 21:09:59.218708 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:59.218673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:09:59.219116 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:09:59.218766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:09:59.219116 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:59.218815    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 21:09:59.219116 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:59.218834    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b95f9f575-q56k9: secret "image-registry-tls" not found
Jul 13 21:09:59.219116 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:59.218884    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls podName:f0e84464-f726-466c-b36a-f6718a50c0a4 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:07.218869298 +0000 UTC m=+51.074014158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls") pod "image-registry-6b95f9f575-q56k9" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4") : secret "image-registry-tls" not found
Jul 13 21:09:59.219116 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:59.218885    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 21:09:59.219116 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:09:59.218945    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls podName:0ac615bd-67c0-46c3-a479-9f5031782569 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:07.218928324 +0000 UTC m=+51.074073186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls") pod "dns-default-zf7m7" (UID: "0ac615bd-67c0-46c3-a479-9f5031782569") : secret "dns-default-metrics-tls" not found
Jul 13 21:10:07.279803 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:07.279762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:10:07.280267 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:07.279820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:10:07.280267 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:07.279914    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 21:10:07.280267 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:07.279915    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 21:10:07.280267 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:07.279982    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls podName:0ac615bd-67c0-46c3-a479-9f5031782569 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:23.279965437 +0000 UTC m=+67.135110297 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls") pod "dns-default-zf7m7" (UID: "0ac615bd-67c0-46c3-a479-9f5031782569") : secret "dns-default-metrics-tls" not found
Jul 13 21:10:07.280267 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:07.279925    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b95f9f575-q56k9: secret "image-registry-tls" not found
Jul 13 21:10:07.280267 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:07.280061    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls podName:f0e84464-f726-466c-b36a-f6718a50c0a4 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:23.280049674 +0000 UTC m=+67.135194533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls") pod "image-registry-6b95f9f575-q56k9" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4") : secret "image-registry-tls" not found
Jul 13 21:10:17.874875 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:17.874848    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l84wn"
Jul 13 21:10:22.587084 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.587033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:10:22.587084 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.587094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:10:22.589081 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.589062    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 21:10:22.589720 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.589706    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 21:10:22.600987 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.600954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ac8fbb-a563-481d-87cc-49188ab19fc4-original-pull-secret\") pod \"global-pull-secret-syncer-2b859\" (UID: \"23ac8fbb-a563-481d-87cc-49188ab19fc4\") " pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:10:22.601105 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.601049    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9482820b-d3b9-4d4e-b538-6c33fcbf5312-metrics-certs\") pod \"network-metrics-daemon-b86vq\" (UID: \"9482820b-d3b9-4d4e-b538-6c33fcbf5312\") " pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:10:22.628711 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.628688    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fgl7x\""
Jul 13 21:10:22.632252 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.632235    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b859"
Jul 13 21:10:22.637425 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.637412    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b86vq"
Jul 13 21:10:22.688499 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.688359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vhs\" (UniqueName: \"kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs\") pod \"network-check-target-2d9kz\" (UID: \"5f63c403-8578-484c-a608-54939ba529d6\") " pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:10:22.691512 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.691484    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 21:10:22.701168 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.700949    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 21:10:22.712430 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.712373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6vhs\" (UniqueName: \"kubernetes.io/projected/5f63c403-8578-484c-a608-54939ba529d6-kube-api-access-d6vhs\") pod \"network-check-target-2d9kz\" (UID: \"5f63c403-8578-484c-a608-54939ba529d6\") " pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:10:22.758251 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.758227    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2b859"]
Jul 13 21:10:22.763013 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:22.762986    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ac8fbb_a563_481d_87cc_49188ab19fc4.slice/crio-5f3115fe483ea5e5ffc7a268836f85ebae6b4837ec09c45f29d9f287d5644e69 WatchSource:0}: Error finding container 5f3115fe483ea5e5ffc7a268836f85ebae6b4837ec09c45f29d9f287d5644e69: Status 404 returned error can't find the container with id 5f3115fe483ea5e5ffc7a268836f85ebae6b4837ec09c45f29d9f287d5644e69
Jul 13 21:10:22.775019 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.774990    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b86vq"]
Jul 13 21:10:22.779627 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:22.779606    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9482820b_d3b9_4d4e_b538_6c33fcbf5312.slice/crio-9b46bc5fde49737d69c362867ea5dda03835b2300f9551127fc5bff35e52b136 WatchSource:0}: Error finding container 9b46bc5fde49737d69c362867ea5dda03835b2300f9551127fc5bff35e52b136: Status 404 returned error can't find the container with id 9b46bc5fde49737d69c362867ea5dda03835b2300f9551127fc5bff35e52b136
Jul 13 21:10:22.922759 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.922734    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gq4dz\""
Jul 13 21:10:22.931392 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.931362    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:10:22.964754 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.964723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b86vq" event={"ID":"9482820b-d3b9-4d4e-b538-6c33fcbf5312","Type":"ContainerStarted","Data":"9b46bc5fde49737d69c362867ea5dda03835b2300f9551127fc5bff35e52b136"}
Jul 13 21:10:22.965850 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:22.965823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2b859" event={"ID":"23ac8fbb-a563-481d-87cc-49188ab19fc4","Type":"ContainerStarted","Data":"5f3115fe483ea5e5ffc7a268836f85ebae6b4837ec09c45f29d9f287d5644e69"}
Jul 13 21:10:23.051670 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.051639    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2d9kz"]
Jul 13 21:10:23.055190 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:23.055163    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f63c403_8578_484c_a608_54939ba529d6.slice/crio-8d884cc4abfb54917fb22635cb889627dfb87fae10c146757d8fb13e33ea6bff WatchSource:0}: Error finding container 8d884cc4abfb54917fb22635cb889627dfb87fae10c146757d8fb13e33ea6bff: Status 404 returned error can't find the container with id 8d884cc4abfb54917fb22635cb889627dfb87fae10c146757d8fb13e33ea6bff
Jul 13 21:10:23.292301 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.292223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:10:23.292301 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.292291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:10:23.295075 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.295046    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls\") pod \"image-registry-6b95f9f575-q56k9\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") " pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:10:23.295355 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.295339    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ac615bd-67c0-46c3-a479-9f5031782569-metrics-tls\") pod \"dns-default-zf7m7\" (UID: \"0ac615bd-67c0-46c3-a479-9f5031782569\") " pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:10:23.314840 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.314814    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqhqf\""
Jul 13 21:10:23.323469 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.323448    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:10:23.472217 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.472181    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zf7m7"]
Jul 13 21:10:23.476494 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:23.476454    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac615bd_67c0_46c3_a479_9f5031782569.slice/crio-df6d21c40861ac7159a4085020895e48698794b886a430641e4e97726a934014 WatchSource:0}: Error finding container df6d21c40861ac7159a4085020895e48698794b886a430641e4e97726a934014: Status 404 returned error can't find the container with id df6d21c40861ac7159a4085020895e48698794b886a430641e4e97726a934014
Jul 13 21:10:23.597765 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.597692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2l9mp\""
Jul 13 21:10:23.606477 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.606453    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:10:23.828180 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.828150    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"]
Jul 13 21:10:23.830329 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.830307    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"
Jul 13 21:10:23.835371 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.835348    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v9q52\""
Jul 13 21:10:23.836833 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.835627    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 13 21:10:23.836833 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.835902    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 21:10:23.836833 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.836129    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 21:10:23.836833 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.836461    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-d7676"]
Jul 13 21:10:23.836833 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.836550    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 13 21:10:23.841985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.841643    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:23.844068 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.844041    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vqsfd\""
Jul 13 21:10:23.844302 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.844283    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 13 21:10:23.844547 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.844528    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:10:23.844737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.844721    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 13 21:10:23.846681 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.846478    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 13 21:10:23.847857 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.847789    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"]
Jul 13 21:10:23.851802 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.851692    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 13 21:10:23.857362 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.857132    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-d7676"]
Jul 13 21:10:23.898143 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.898116    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a7e4be6a-c380-426f-a6d3-d224bcfa09c1-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-cvzz6\" (UID: \"a7e4be6a-c380-426f-a6d3-d224bcfa09c1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"
Jul 13 21:10:23.898236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.898162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7e4be6a-c380-426f-a6d3-d224bcfa09c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cvzz6\" (UID: \"a7e4be6a-c380-426f-a6d3-d224bcfa09c1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"
Jul 13 21:10:23.898236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.898194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmkb7\" (UniqueName: \"kubernetes.io/projected/a7e4be6a-c380-426f-a6d3-d224bcfa09c1-kube-api-access-bmkb7\") pod \"cluster-monitoring-operator-5f7f494dd4-cvzz6\" (UID: \"a7e4be6a-c380-426f-a6d3-d224bcfa09c1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"
Jul 13 21:10:23.898236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.898220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf2rh\" (UniqueName: \"kubernetes.io/projected/12d8caae-7bc1-46fd-9f2a-319beb4ecba5-kube-api-access-rf2rh\") pod \"console-operator-7866497494-d7676\" (UID: \"12d8caae-7bc1-46fd-9f2a-319beb4ecba5\") " pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:23.898337 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.898255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12d8caae-7bc1-46fd-9f2a-319beb4ecba5-config\") pod \"console-operator-7866497494-d7676\" (UID: \"12d8caae-7bc1-46fd-9f2a-319beb4ecba5\") " pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:23.898337 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.898278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12d8caae-7bc1-46fd-9f2a-319beb4ecba5-serving-cert\") pod \"console-operator-7866497494-d7676\" (UID: \"12d8caae-7bc1-46fd-9f2a-319beb4ecba5\") " pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:23.898337 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.898311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d8caae-7bc1-46fd-9f2a-319beb4ecba5-trusted-ca\") pod \"console-operator-7866497494-d7676\" (UID: \"12d8caae-7bc1-46fd-9f2a-319beb4ecba5\") " pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:23.900073 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.900048    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b95f9f575-q56k9"]
Jul 13 21:10:23.907181 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:23.907149    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e84464_f726_466c_b36a_f6718a50c0a4.slice/crio-b730c4ad78a01b8c512d3f7b1d020835d54075422904e47f4b35424d41eb3608 WatchSource:0}: Error finding container b730c4ad78a01b8c512d3f7b1d020835d54075422904e47f4b35424d41eb3608: Status 404 returned error can't find the container with id b730c4ad78a01b8c512d3f7b1d020835d54075422904e47f4b35424d41eb3608
Jul 13 21:10:23.926231 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.925317    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"]
Jul 13 21:10:23.932071 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.932048    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85856c9868-5bg85"]
Jul 13 21:10:23.932268 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.932229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"
Jul 13 21:10:23.935502 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.935295    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 13 21:10:23.935694 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.935674    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 13 21:10:23.935788 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.935767    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:10:23.935990 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.935970    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 13 21:10:23.936265 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.936243    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rlzlx"]
Jul 13 21:10:23.937026 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.936466    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:23.937247 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.937228    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l8b72\""
Jul 13 21:10:23.938366 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.938348    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:23.942299 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.941527    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 21:10:23.942299 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.941815    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6qf5l\""
Jul 13 21:10:23.942299 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.942033    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 13 21:10:23.942672 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.942413    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 13 21:10:23.942672 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.942430    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 21:10:23.942672 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.942535    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 21:10:23.942672 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.942415    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 21:10:23.945058 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.945036    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 13 21:10:23.945315 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.945298    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 13 21:10:23.946303 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.946279    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 13 21:10:23.946847 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.946826    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 13 21:10:23.949425 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.948719    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fdzt6\""
Jul 13 21:10:23.954939 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.954914    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 13 21:10:23.961818 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.961798    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"]
Jul 13 21:10:23.966349 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.966293    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85856c9868-5bg85"]
Jul 13 21:10:23.969982 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.969946    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rlzlx"]
Jul 13 21:10:23.973133 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.972995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2d9kz" event={"ID":"5f63c403-8578-484c-a608-54939ba529d6","Type":"ContainerStarted","Data":"8d884cc4abfb54917fb22635cb889627dfb87fae10c146757d8fb13e33ea6bff"}
Jul 13 21:10:23.975522 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.975337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9" event={"ID":"f0e84464-f726-466c-b36a-f6718a50c0a4","Type":"ContainerStarted","Data":"b730c4ad78a01b8c512d3f7b1d020835d54075422904e47f4b35424d41eb3608"}
Jul 13 21:10:23.978394 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.978351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zf7m7" event={"ID":"0ac615bd-67c0-46c3-a479-9f5031782569","Type":"ContainerStarted","Data":"df6d21c40861ac7159a4085020895e48698794b886a430641e4e97726a934014"}
Jul 13 21:10:23.984531 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.984473    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b86vq" event={"ID":"9482820b-d3b9-4d4e-b538-6c33fcbf5312","Type":"ContainerStarted","Data":"f0eb49849ac646136ae15fe902ea945a511b29c9fd885668699ef8fc23384c45"}
Jul 13 21:10:23.999009 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.998985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d8caae-7bc1-46fd-9f2a-319beb4ecba5-trusted-ca\") pod \"console-operator-7866497494-d7676\" (UID: \"12d8caae-7bc1-46fd-9f2a-319beb4ecba5\") " pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:23.999199 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:23.999181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-snapshots\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.000970 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.000846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d8caae-7bc1-46fd-9f2a-319beb4ecba5-trusted-ca\") pod \"console-operator-7866497494-d7676\" (UID: \"12d8caae-7bc1-46fd-9f2a-319beb4ecba5\") " pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:24.000970 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.000894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b465m\" (UniqueName: \"kubernetes.io/projected/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-kube-api-access-b465m\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.000970 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.000948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.001184 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.000989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7e4be6a-c380-426f-a6d3-d224bcfa09c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cvzz6\" (UID: \"a7e4be6a-c380-426f-a6d3-d224bcfa09c1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"
Jul 13 21:10:24.001184 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-serving-cert\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.001184 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cfd0ba3a-0c38-431e-b74b-92e8b97a295f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-d4tmx\" (UID: \"cfd0ba3a-0c38-431e-b74b-92e8b97a295f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"
Jul 13 21:10:24.001184 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmkb7\" (UniqueName: \"kubernetes.io/projected/a7e4be6a-c380-426f-a6d3-d224bcfa09c1-kube-api-access-bmkb7\") pod \"cluster-monitoring-operator-5f7f494dd4-cvzz6\" (UID: \"a7e4be6a-c380-426f-a6d3-d224bcfa09c1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"
Jul 13 21:10:24.001184 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-metrics-certs\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.001184 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12d8caae-7bc1-46fd-9f2a-319beb4ecba5-serving-cert\") pod \"console-operator-7866497494-d7676\" (UID: \"12d8caae-7bc1-46fd-9f2a-319beb4ecba5\") " pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:24.001184 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12d8caae-7bc1-46fd-9f2a-319beb4ecba5-config\") pod \"console-operator-7866497494-d7676\" (UID: \"12d8caae-7bc1-46fd-9f2a-319beb4ecba5\") " pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:24.001184 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-service-ca-bundle\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.001639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c95wf\" (UniqueName: \"kubernetes.io/projected/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-kube-api-access-c95wf\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.001639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001241    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-stats-auth\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.001639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd0ba3a-0c38-431e-b74b-92e8b97a295f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-d4tmx\" (UID: \"cfd0ba3a-0c38-431e-b74b-92e8b97a295f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"
Jul 13 21:10:24.001639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.001639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a7e4be6a-c380-426f-a6d3-d224bcfa09c1-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-cvzz6\" (UID: \"a7e4be6a-c380-426f-a6d3-d224bcfa09c1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"
Jul 13 21:10:24.001639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001353    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-tmp\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.001639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf2rh\" (UniqueName: \"kubernetes.io/projected/12d8caae-7bc1-46fd-9f2a-319beb4ecba5-kube-api-access-rf2rh\") pod \"console-operator-7866497494-d7676\" (UID: \"12d8caae-7bc1-46fd-9f2a-319beb4ecba5\") " pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:24.001639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-default-certificate\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.001639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.001464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t457\" (UniqueName: \"kubernetes.io/projected/cfd0ba3a-0c38-431e-b74b-92e8b97a295f-kube-api-access-7t457\") pod \"kube-storage-version-migrator-operator-799cb7f958-d4tmx\" (UID: \"cfd0ba3a-0c38-431e-b74b-92e8b97a295f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"
Jul 13 21:10:24.003623 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.003525    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a7e4be6a-c380-426f-a6d3-d224bcfa09c1-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-cvzz6\" (UID: \"a7e4be6a-c380-426f-a6d3-d224bcfa09c1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"
Jul 13 21:10:24.004148 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.004127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12d8caae-7bc1-46fd-9f2a-319beb4ecba5-config\") pod \"console-operator-7866497494-d7676\" (UID: \"12d8caae-7bc1-46fd-9f2a-319beb4ecba5\") " pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:24.004240 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.004223    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12d8caae-7bc1-46fd-9f2a-319beb4ecba5-serving-cert\") pod \"console-operator-7866497494-d7676\" (UID: \"12d8caae-7bc1-46fd-9f2a-319beb4ecba5\") " pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:24.006874 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.006790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7e4be6a-c380-426f-a6d3-d224bcfa09c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cvzz6\" (UID: \"a7e4be6a-c380-426f-a6d3-d224bcfa09c1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"
Jul 13 21:10:24.014016 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.013945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf2rh\" (UniqueName: \"kubernetes.io/projected/12d8caae-7bc1-46fd-9f2a-319beb4ecba5-kube-api-access-rf2rh\") pod \"console-operator-7866497494-d7676\" (UID: \"12d8caae-7bc1-46fd-9f2a-319beb4ecba5\") " pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:24.014763 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.014740    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmkb7\" (UniqueName: \"kubernetes.io/projected/a7e4be6a-c380-426f-a6d3-d224bcfa09c1-kube-api-access-bmkb7\") pod \"cluster-monitoring-operator-5f7f494dd4-cvzz6\" (UID: \"a7e4be6a-c380-426f-a6d3-d224bcfa09c1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"
Jul 13 21:10:24.101976 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.101884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-service-ca-bundle\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.101976 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.101924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c95wf\" (UniqueName: \"kubernetes.io/projected/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-kube-api-access-c95wf\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.101976 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.101953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-stats-auth\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.102229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.101991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd0ba3a-0c38-431e-b74b-92e8b97a295f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-d4tmx\" (UID: \"cfd0ba3a-0c38-431e-b74b-92e8b97a295f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"
Jul 13 21:10:24.102229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.102015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.102229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.102040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-tmp\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.102229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.102064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-default-certificate\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.102229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.102092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t457\" (UniqueName: \"kubernetes.io/projected/cfd0ba3a-0c38-431e-b74b-92e8b97a295f-kube-api-access-7t457\") pod \"kube-storage-version-migrator-operator-799cb7f958-d4tmx\" (UID: \"cfd0ba3a-0c38-431e-b74b-92e8b97a295f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"
Jul 13 21:10:24.102229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.102123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-snapshots\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.102229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.102146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b465m\" (UniqueName: \"kubernetes.io/projected/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-kube-api-access-b465m\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.102229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.102178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.102229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.102217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-serving-cert\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.102772 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.102240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cfd0ba3a-0c38-431e-b74b-92e8b97a295f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-d4tmx\" (UID: \"cfd0ba3a-0c38-431e-b74b-92e8b97a295f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"
Jul 13 21:10:24.102772 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.102271    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-metrics-certs\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.104573 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.103064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-service-ca-bundle\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.104573 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.103260    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-tmp\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.104573 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.104024    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.104573 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.104127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.104573 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.104178    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-snapshots\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.104573 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.104532    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cfd0ba3a-0c38-431e-b74b-92e8b97a295f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-d4tmx\" (UID: \"cfd0ba3a-0c38-431e-b74b-92e8b97a295f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"
Jul 13 21:10:24.106322 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.106296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-default-certificate\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.107534 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.107494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-metrics-certs\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.108755 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.108731    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-stats-auth\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.108846 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.108791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-serving-cert\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.112624 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.112581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t457\" (UniqueName: \"kubernetes.io/projected/cfd0ba3a-0c38-431e-b74b-92e8b97a295f-kube-api-access-7t457\") pod \"kube-storage-version-migrator-operator-799cb7f958-d4tmx\" (UID: \"cfd0ba3a-0c38-431e-b74b-92e8b97a295f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"
Jul 13 21:10:24.114330 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.114230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c95wf\" (UniqueName: \"kubernetes.io/projected/b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9-kube-api-access-c95wf\") pod \"router-default-85856c9868-5bg85\" (UID: \"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9\") " pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.115026 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.114930    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b465m\" (UniqueName: \"kubernetes.io/projected/27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf-kube-api-access-b465m\") pod \"insights-operator-68d9dd94cf-rlzlx\" (UID: \"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.117187 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.117143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd0ba3a-0c38-431e-b74b-92e8b97a295f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-d4tmx\" (UID: \"cfd0ba3a-0c38-431e-b74b-92e8b97a295f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"
Jul 13 21:10:24.154354 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.154257    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"
Jul 13 21:10:24.172986 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.172529    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:24.261461 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.260747    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"
Jul 13 21:10:24.295236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.294982    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:24.305516 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.305178    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx"
Jul 13 21:10:24.355223 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.355112    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6"]
Jul 13 21:10:24.386591 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.386508    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-d7676"]
Jul 13 21:10:24.483336 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:24.483284    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd0ba3a_0c38_431e_b74b_92e8b97a295f.slice/crio-52f8a03399ac0fda1c3c6b0dde327fc9f75b7f72c07af2d2ebe033a889e31285 WatchSource:0}: Error finding container 52f8a03399ac0fda1c3c6b0dde327fc9f75b7f72c07af2d2ebe033a889e31285: Status 404 returned error can't find the container with id 52f8a03399ac0fda1c3c6b0dde327fc9f75b7f72c07af2d2ebe033a889e31285
Jul 13 21:10:24.486670 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.486599    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx"]
Jul 13 21:10:24.509766 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.509686    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85856c9868-5bg85"]
Jul 13 21:10:24.519449 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:24.519412    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b2ab89_b507_4fe3_b1d1_ac4b7d4eb0c9.slice/crio-c69695a991bb52088aba931efa32d60a20243a8f5e65abe02b1b494a0533a5c9 WatchSource:0}: Error finding container c69695a991bb52088aba931efa32d60a20243a8f5e65abe02b1b494a0533a5c9: Status 404 returned error can't find the container with id c69695a991bb52088aba931efa32d60a20243a8f5e65abe02b1b494a0533a5c9
Jul 13 21:10:24.529887 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.529861    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rlzlx"]
Jul 13 21:10:24.539592 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:24.539565    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c50b55_4334_4c9d_be8b_d3b6d3dfd3cf.slice/crio-6575bc25fdba50f476b711f3f18b74fd2ac0947ae28cecd0a199c9dd6d60f22b WatchSource:0}: Error finding container 6575bc25fdba50f476b711f3f18b74fd2ac0947ae28cecd0a199c9dd6d60f22b: Status 404 returned error can't find the container with id 6575bc25fdba50f476b711f3f18b74fd2ac0947ae28cecd0a199c9dd6d60f22b
Jul 13 21:10:24.992410 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.992047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9" event={"ID":"f0e84464-f726-466c-b36a-f6718a50c0a4","Type":"ContainerStarted","Data":"d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26"}
Jul 13 21:10:24.992410 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.992136    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:10:24.995335 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.994868    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b86vq" event={"ID":"9482820b-d3b9-4d4e-b538-6c33fcbf5312","Type":"ContainerStarted","Data":"07b1354f308c8f4a9cd995b4def1411a1b0ce3a769c62123cefde9d7aa902c43"}
Jul 13 21:10:24.996537 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.996476    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx" event={"ID":"cfd0ba3a-0c38-431e-b74b-92e8b97a295f","Type":"ContainerStarted","Data":"52f8a03399ac0fda1c3c6b0dde327fc9f75b7f72c07af2d2ebe033a889e31285"}
Jul 13 21:10:24.998154 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.998085    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6" event={"ID":"a7e4be6a-c380-426f-a6d3-d224bcfa09c1","Type":"ContainerStarted","Data":"65d863609222340e6876ca0c845f303e9ca83962e53dfd9c43e9cc0476016f66"}
Jul 13 21:10:24.999564 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:24.999540    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-d7676" event={"ID":"12d8caae-7bc1-46fd-9f2a-319beb4ecba5","Type":"ContainerStarted","Data":"6065eecb7ba91fb18bc36d6b02c8fe04e27067531850a4bb9531eeb4b6d5571c"}
Jul 13 21:10:25.001755 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:25.001697    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx" event={"ID":"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf","Type":"ContainerStarted","Data":"6575bc25fdba50f476b711f3f18b74fd2ac0947ae28cecd0a199c9dd6d60f22b"}
Jul 13 21:10:25.004174 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:25.004151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85856c9868-5bg85" event={"ID":"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9","Type":"ContainerStarted","Data":"7e94b56c947543f4cba35a25b31f051695dd05566e6cfc50b42aedbc24b806af"}
Jul 13 21:10:25.004286 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:25.004187    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85856c9868-5bg85" event={"ID":"b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9","Type":"ContainerStarted","Data":"c69695a991bb52088aba931efa32d60a20243a8f5e65abe02b1b494a0533a5c9"}
Jul 13 21:10:25.017276 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:25.017217    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9" podStartSLOduration=70.017192551 podStartE2EDuration="1m10.017192551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:09:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:25.009113128 +0000 UTC m=+68.864258024" watchObservedRunningTime="2026-07-13 21:10:25.017192551 +0000 UTC m=+68.872337442"
Jul 13 21:10:25.029618 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:25.029506    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b86vq" podStartSLOduration=68.021105755 podStartE2EDuration="1m9.029488299s" totalImagesPullingTime="1.008382544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:25.028951526 +0000 UTC m=+68.884096408" watchObservedRunningTime="2026-07-13 21:10:25.029488299 +0000 UTC m=+68.884633183"
Jul 13 21:10:25.296250 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:25.296169    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:25.298909 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:25.298883    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:25.318460 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:25.318187    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85856c9868-5bg85" podStartSLOduration=2.318168503 podStartE2EDuration="2.318168503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:25.047756362 +0000 UTC m=+68.902901247" watchObservedRunningTime="2026-07-13 21:10:25.318168503 +0000 UTC m=+69.173313365"
Jul 13 21:10:26.016316 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:26.016238    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:26.017842 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:26.017636    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85856c9868-5bg85"
Jul 13 21:10:27.021828 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:27.021736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zf7m7" event={"ID":"0ac615bd-67c0-46c3-a479-9f5031782569","Type":"ContainerStarted","Data":"a170d037b9636c88894fda225833698459109477078cd41bc04415032255edcd"}
Jul 13 21:10:27.021828 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:27.021791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zf7m7" event={"ID":"0ac615bd-67c0-46c3-a479-9f5031782569","Type":"ContainerStarted","Data":"c58c86b4be791f2716d3cde09b3f1a65264d642830835dea402d79e442f2bb91"}
Jul 13 21:10:27.038132 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:27.038076    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zf7m7" podStartSLOduration=33.086209791 podStartE2EDuration="36.038054682s" totalImagesPullingTime="2.951844891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:27.036847 +0000 UTC m=+70.891991883" watchObservedRunningTime="2026-07-13 21:10:27.038054682 +0000 UTC m=+70.893199634"
Jul 13 21:10:28.025609 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:28.025509    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:10:32.040558 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.040521    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx" event={"ID":"cfd0ba3a-0c38-431e-b74b-92e8b97a295f","Type":"ContainerStarted","Data":"76db64f59bd3be8c4cf9dfb73518df468d7b691fd90cd8a67a7f987a96da131c"}
Jul 13 21:10:32.042367 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.042336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6" event={"ID":"a7e4be6a-c380-426f-a6d3-d224bcfa09c1","Type":"ContainerStarted","Data":"1797a42d870be90c667db800e1164ef429f6b5b934b96d6ffc7e1dbf0e04cbdc"}
Jul 13 21:10:32.044788 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.044759    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2b859" event={"ID":"23ac8fbb-a563-481d-87cc-49188ab19fc4","Type":"ContainerStarted","Data":"7ca8fdc562b512482a9f1766d4b76c5adefcc6874da8cfebf42e84b68c792be7"}
Jul 13 21:10:32.046484 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.046461    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2d9kz" event={"ID":"5f63c403-8578-484c-a608-54939ba529d6","Type":"ContainerStarted","Data":"162fdb9f7f4e56a8072cf78f5c78777735f510c890fcf9243fcd0c54ee7d2818"}
Jul 13 21:10:32.046881 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.046864    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:10:32.048502 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.048479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-d7676" event={"ID":"12d8caae-7bc1-46fd-9f2a-319beb4ecba5","Type":"ContainerStarted","Data":"2664e59dd39183969da52493e404b3448c3d49c20a9437f343b08a919e999790"}
Jul 13 21:10:32.048612 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.048583    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:32.050218 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.050194    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx" event={"ID":"27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf","Type":"ContainerStarted","Data":"da3857a134a45b09df56cbefabd910136ea4322dd74c3d75729afc7179abdc75"}
Jul 13 21:10:32.058741 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.058691    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d4tmx" podStartSLOduration=1.980465481 podStartE2EDuration="9.058674664s" totalImagesPullingTime="7.078209183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:32.057949126 +0000 UTC m=+75.913094009" watchObservedRunningTime="2026-07-13 21:10:32.058674664 +0000 UTC m=+75.913819549"
Jul 13 21:10:32.077975 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.077132    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-d7676" podStartSLOduration=1.914541488 podStartE2EDuration="9.077114843s" totalImagesPullingTime="7.162573355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:32.076210331 +0000 UTC m=+75.931355213" watchObservedRunningTime="2026-07-13 21:10:32.077114843 +0000 UTC m=+75.932259721"
Jul 13 21:10:32.107695 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.107638    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2b859" podStartSLOduration=67.302865574 podStartE2EDuration="1m16.10760769s" totalImagesPullingTime="8.804742116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:32.106304453 +0000 UTC m=+75.961449337" watchObservedRunningTime="2026-07-13 21:10:32.10760769 +0000 UTC m=+75.962752574"
Jul 13 21:10:32.123393 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.123333    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cvzz6" podStartSLOduration=1.9319650959999999 podStartE2EDuration="9.123319616s" totalImagesPullingTime="7.19135452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:32.122956877 +0000 UTC m=+75.978101762" watchObservedRunningTime="2026-07-13 21:10:32.123319616 +0000 UTC m=+75.978464524"
Jul 13 21:10:32.161049 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.160998    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2d9kz" podStartSLOduration=67.661810347 podStartE2EDuration="1m16.160983479s" totalImagesPullingTime="8.499173132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:32.142354837 +0000 UTC m=+75.997499712" watchObservedRunningTime="2026-07-13 21:10:32.160983479 +0000 UTC m=+76.016128360"
Jul 13 21:10:32.161500 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.161473    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-rlzlx" podStartSLOduration=2.146417623 podStartE2EDuration="9.161466147s" totalImagesPullingTime="7.015048524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:32.160337272 +0000 UTC m=+76.015482157" watchObservedRunningTime="2026-07-13 21:10:32.161466147 +0000 UTC m=+76.016611106"
Jul 13 21:10:32.983347 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:32.983316    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-d7676"
Jul 13 21:10:33.660048 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.660010    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s5cvs"]
Jul 13 21:10:33.662457 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.662435    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.664585 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.664562    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 21:10:33.664691 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.664560    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gz76z\""
Jul 13 21:10:33.665306 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.665287    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 21:10:33.675540 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.675517    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s5cvs"]
Jul 13 21:10:33.779608 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.779574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z8nf\" (UniqueName: \"kubernetes.io/projected/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-api-access-9z8nf\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.779758 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.779614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.779758 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.779643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-crio-socket\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.779758 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.779703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-data-volume\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.779758 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.779735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.880901 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.880859    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-data-volume\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.880901 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.880907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.881131 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.880938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z8nf\" (UniqueName: \"kubernetes.io/projected/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-api-access-9z8nf\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.881131 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.880958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.881131 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.880976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-crio-socket\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.881131 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.881065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-crio-socket\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.881131 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:33.881095    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 21:10:33.881131 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:33.881105    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 21:10:33.881340 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:33.881173    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-rbac-proxy-cm podName:68b0bfb3-106f-4f8e-8a9e-8200729e2eaa nodeName:}" failed. No retries permitted until 2026-07-13 21:10:34.38115572 +0000 UTC m=+78.236300580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s5cvs" (UID: "68b0bfb3-106f-4f8e-8a9e-8200729e2eaa") : configmap "kube-rbac-proxy" not found
Jul 13 21:10:33.881340 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:33.881187    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls podName:68b0bfb3-106f-4f8e-8a9e-8200729e2eaa nodeName:}" failed. No retries permitted until 2026-07-13 21:10:34.381181106 +0000 UTC m=+78.236325966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s5cvs" (UID: "68b0bfb3-106f-4f8e-8a9e-8200729e2eaa") : secret "insights-runtime-extractor-tls" not found
Jul 13 21:10:33.881340 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.881247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-data-volume\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:33.888425 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:33.888405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z8nf\" (UniqueName: \"kubernetes.io/projected/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-api-access-9z8nf\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:34.384193 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:34.384160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:34.384354 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:34.384206    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:34.384354 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:34.384281    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 21:10:34.384354 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:34.384298    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 21:10:34.384354 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:34.384330    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-rbac-proxy-cm podName:68b0bfb3-106f-4f8e-8a9e-8200729e2eaa nodeName:}" failed. No retries permitted until 2026-07-13 21:10:35.384317824 +0000 UTC m=+79.239462683 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s5cvs" (UID: "68b0bfb3-106f-4f8e-8a9e-8200729e2eaa") : configmap "kube-rbac-proxy" not found
Jul 13 21:10:34.384518 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:34.384359    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls podName:68b0bfb3-106f-4f8e-8a9e-8200729e2eaa nodeName:}" failed. No retries permitted until 2026-07-13 21:10:35.384346414 +0000 UTC m=+79.239491275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s5cvs" (UID: "68b0bfb3-106f-4f8e-8a9e-8200729e2eaa") : secret "insights-runtime-extractor-tls" not found
Jul 13 21:10:35.392600 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:35.392566    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:35.392969 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:35.392619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:35.392969 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:35.392702    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 21:10:35.392969 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:35.392720    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 21:10:35.392969 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:35.392782    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-rbac-proxy-cm podName:68b0bfb3-106f-4f8e-8a9e-8200729e2eaa nodeName:}" failed. No retries permitted until 2026-07-13 21:10:37.392764297 +0000 UTC m=+81.247909158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s5cvs" (UID: "68b0bfb3-106f-4f8e-8a9e-8200729e2eaa") : configmap "kube-rbac-proxy" not found
Jul 13 21:10:35.392969 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:35.392795    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls podName:68b0bfb3-106f-4f8e-8a9e-8200729e2eaa nodeName:}" failed. No retries permitted until 2026-07-13 21:10:37.392789899 +0000 UTC m=+81.247934760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s5cvs" (UID: "68b0bfb3-106f-4f8e-8a9e-8200729e2eaa") : secret "insights-runtime-extractor-tls" not found
Jul 13 21:10:35.856102 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:35.856024    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zf7m7_0ac615bd-67c0-46c3-a479-9f5031782569/dns/0.log"
Jul 13 21:10:36.042402 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:36.042349    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zf7m7_0ac615bd-67c0-46c3-a479-9f5031782569/kube-rbac-proxy/0.log"
Jul 13 21:10:36.246495 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:36.246467    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gpsp2_d1a7f988-c495-4a1a-a6d6-372164fd830b/dns-node-resolver/0.log"
Jul 13 21:10:37.042551 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:37.042522    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b95f9f575-q56k9_f0e84464-f726-466c-b36a-f6718a50c0a4/registry/0.log"
Jul 13 21:10:37.406995 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:37.406964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:37.407146 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:37.407016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:37.407146 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:37.407117    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 21:10:37.407228 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:37.407184    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls podName:68b0bfb3-106f-4f8e-8a9e-8200729e2eaa nodeName:}" failed. No retries permitted until 2026-07-13 21:10:41.40716734 +0000 UTC m=+85.262312207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s5cvs" (UID: "68b0bfb3-106f-4f8e-8a9e-8200729e2eaa") : secret "insights-runtime-extractor-tls" not found
Jul 13 21:10:37.407506 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:37.407485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:37.641402 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:37.641352    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p8xlt_08b33c6b-c74d-4666-a461-47432d836c89/node-ca/0.log"
Jul 13 21:10:38.031108 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.031079    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zf7m7"
Jul 13 21:10:38.045464 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.045443    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85856c9868-5bg85_b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9/router/0.log"
Jul 13 21:10:38.274366 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.274332    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76d5dcd874-gp886"]
Jul 13 21:10:38.277261 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.277230    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.279659 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.279633    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 21:10:38.279782 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.279720    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 21:10:38.279977 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.279956    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 21:10:38.280035 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.279959    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 21:10:38.280035 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.280010    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 21:10:38.280035 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.279995    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 21:10:38.280178 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.280039    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 21:10:38.280178 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.279968    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ff747\""
Jul 13 21:10:38.288817 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.288798    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76d5dcd874-gp886"]
Jul 13 21:10:38.313851 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.313788    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-service-ca\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.313851 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.313843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-serving-cert\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.314027 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.313990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-config\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.314083 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.314034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44nfr\" (UniqueName: \"kubernetes.io/projected/df89a8b7-a346-4b93-b30e-2f76e6325efb-kube-api-access-44nfr\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.314190 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.314112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-oauth-serving-cert\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.314190 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.314151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-oauth-config\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.415078 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.415050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-service-ca\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.415224 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.415084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-serving-cert\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.415224 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.415099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-config\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.415224 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.415118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44nfr\" (UniqueName: \"kubernetes.io/projected/df89a8b7-a346-4b93-b30e-2f76e6325efb-kube-api-access-44nfr\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.415410 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.415246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-oauth-serving-cert\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.415410 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.415281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-oauth-config\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.415813 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.415787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-config\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.415948 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.415924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-service-ca\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.416021 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.415924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-oauth-serving-cert\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.417574 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.417546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-oauth-config\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.417574 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.417561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-serving-cert\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.422590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.422568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44nfr\" (UniqueName: \"kubernetes.io/projected/df89a8b7-a346-4b93-b30e-2f76e6325efb-kube-api-access-44nfr\") pod \"console-76d5dcd874-gp886\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") " pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.586400 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.586297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:38.642739 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.642707    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wh5tq_2fb02e34-7059-4d59-884f-4e9a747fef9f/serve-healthcheck-canary/0.log"
Jul 13 21:10:38.713443 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:38.713423    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76d5dcd874-gp886"]
Jul 13 21:10:38.715707 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:38.715686    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf89a8b7_a346_4b93_b30e_2f76e6325efb.slice/crio-e6a39ea959355d1f25ebda84716bf672189f8f7e559bde7117c72e0258d025b3 WatchSource:0}: Error finding container e6a39ea959355d1f25ebda84716bf672189f8f7e559bde7117c72e0258d025b3: Status 404 returned error can't find the container with id e6a39ea959355d1f25ebda84716bf672189f8f7e559bde7117c72e0258d025b3
Jul 13 21:10:39.077664 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.077626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d5dcd874-gp886" event={"ID":"df89a8b7-a346-4b93-b30e-2f76e6325efb","Type":"ContainerStarted","Data":"e6a39ea959355d1f25ebda84716bf672189f8f7e559bde7117c72e0258d025b3"}
Jul 13 21:10:39.251535 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.251497    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-d4tmx_cfd0ba3a-0c38-431e-b74b-92e8b97a295f/kube-storage-version-migrator-operator/0.log"
Jul 13 21:10:39.565689 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.565654    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-skmnl"]
Jul 13 21:10:39.570160 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.570139    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7kts5"]
Jul 13 21:10:39.570290 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.570257    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.573280 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.573259    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.573441 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.573313    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 13 21:10:39.573441 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.573327    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 13 21:10:39.573441 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.573347    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 21:10:39.573598 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.573351    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2vlpk\""
Jul 13 21:10:39.574181 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.574168    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 13 21:10:39.575360 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.575340    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 21:10:39.575498 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.575467    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cwc9r\""
Jul 13 21:10:39.575598 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.575499    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 21:10:39.575722 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.575707    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 21:10:39.583228 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.583205    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-skmnl"]
Jul 13 21:10:39.624907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.624872    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-textfile\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.625101 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.624927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-accelerators-collector-config\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.625101 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.624960    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/14926375-8558-4cd8-a953-afca58bcaf40-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.625101 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.625062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4w7t\" (UniqueName: \"kubernetes.io/projected/14926375-8558-4cd8-a953-afca58bcaf40-kube-api-access-s4w7t\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.625281 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.625132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-metrics-client-ca\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.625281 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.625172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14926375-8558-4cd8-a953-afca58bcaf40-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.625281 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.625222    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-sys\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.625281 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.625276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.625590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.625302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14926375-8558-4cd8-a953-afca58bcaf40-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.625590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.625334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-root\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.625590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.625363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-tls\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.625590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.625429    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsbvj\" (UniqueName: \"kubernetes.io/projected/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-kube-api-access-dsbvj\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.625590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.625504    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-wtmp\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.625590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.625530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/14926375-8558-4cd8-a953-afca58bcaf40-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.625590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.625572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14926375-8558-4cd8-a953-afca58bcaf40-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.726867 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.726834    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-accelerators-collector-config\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.726867 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.726869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/14926375-8558-4cd8-a953-afca58bcaf40-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.727052 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.726894    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4w7t\" (UniqueName: \"kubernetes.io/projected/14926375-8558-4cd8-a953-afca58bcaf40-kube-api-access-s4w7t\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.727052 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-metrics-client-ca\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.727123 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14926375-8558-4cd8-a953-afca58bcaf40-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.727123 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-sys\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.727231 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.727231 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14926375-8558-4cd8-a953-afca58bcaf40-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.727231 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-sys\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.727231 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-root\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.727463 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-tls\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.727463 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsbvj\" (UniqueName: \"kubernetes.io/projected/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-kube-api-access-dsbvj\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.727463 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-wtmp\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.727463 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/14926375-8558-4cd8-a953-afca58bcaf40-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.727463 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14926375-8558-4cd8-a953-afca58bcaf40-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.727463 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:39.727417    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 21:10:39.727463 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727435    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-textfile\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.727825 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:39.727488    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-tls podName:65f81efa-d6fb-40dc-9d51-8ad043cf2f72 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:40.227469123 +0000 UTC m=+84.082614004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-tls") pod "node-exporter-7kts5" (UID: "65f81efa-d6fb-40dc-9d51-8ad043cf2f72") : secret "node-exporter-tls" not found
Jul 13 21:10:39.727825 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727648    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-accelerators-collector-config\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.727825 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-root\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.727825 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727726    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-metrics-client-ca\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.727825 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/14926375-8558-4cd8-a953-afca58bcaf40-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.727825 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-wtmp\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.728168 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14926375-8558-4cd8-a953-afca58bcaf40-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.728168 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-textfile\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.728168 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.727983    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/14926375-8558-4cd8-a953-afca58bcaf40-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.729855 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.729820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14926375-8558-4cd8-a953-afca58bcaf40-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.729981 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.729864    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.730057 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.730041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14926375-8558-4cd8-a953-afca58bcaf40-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.737285 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.737257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4w7t\" (UniqueName: \"kubernetes.io/projected/14926375-8558-4cd8-a953-afca58bcaf40-kube-api-access-s4w7t\") pod \"kube-state-metrics-785778ff74-skmnl\" (UID: \"14926375-8558-4cd8-a953-afca58bcaf40\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:39.738143 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.738126    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsbvj\" (UniqueName: \"kubernetes.io/projected/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-kube-api-access-dsbvj\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:39.882871 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:39.882791    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl"
Jul 13 21:10:40.034074 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:40.033931    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-skmnl"]
Jul 13 21:10:40.036470 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:40.036447    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14926375_8558_4cd8_a953_afca58bcaf40.slice/crio-057325ddbebb118948e1cd49589ce8ed32d925f6ca1685696f4982f7f3277321 WatchSource:0}: Error finding container 057325ddbebb118948e1cd49589ce8ed32d925f6ca1685696f4982f7f3277321: Status 404 returned error can't find the container with id 057325ddbebb118948e1cd49589ce8ed32d925f6ca1685696f4982f7f3277321
Jul 13 21:10:40.083707 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:40.083683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl" event={"ID":"14926375-8558-4cd8-a953-afca58bcaf40","Type":"ContainerStarted","Data":"057325ddbebb118948e1cd49589ce8ed32d925f6ca1685696f4982f7f3277321"}
Jul 13 21:10:40.232176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:40.232125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-tls\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:40.234528 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:40.234499    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65f81efa-d6fb-40dc-9d51-8ad043cf2f72-node-exporter-tls\") pod \"node-exporter-7kts5\" (UID: \"65f81efa-d6fb-40dc-9d51-8ad043cf2f72\") " pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:40.489116 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:40.489028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7kts5"
Jul 13 21:10:40.501445 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:40.501418    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f81efa_d6fb_40dc_9d51_8ad043cf2f72.slice/crio-760f63a06adc1cb2aa00fd0307f5b993d22b8d5ea1fa9eebdebe443d5a570f1a WatchSource:0}: Error finding container 760f63a06adc1cb2aa00fd0307f5b993d22b8d5ea1fa9eebdebe443d5a570f1a: Status 404 returned error can't find the container with id 760f63a06adc1cb2aa00fd0307f5b993d22b8d5ea1fa9eebdebe443d5a570f1a
Jul 13 21:10:41.089571 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.089533    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7kts5" event={"ID":"65f81efa-d6fb-40dc-9d51-8ad043cf2f72","Type":"ContainerStarted","Data":"760f63a06adc1cb2aa00fd0307f5b993d22b8d5ea1fa9eebdebe443d5a570f1a"}
Jul 13 21:10:41.446738 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.446686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:41.449600 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.449571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68b0bfb3-106f-4f8e-8a9e-8200729e2eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s5cvs\" (UID: \"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa\") " pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:41.471203 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.471173    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s5cvs"
Jul 13 21:10:41.523748 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.523720    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"]
Jul 13 21:10:41.527679 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.527660    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.530402 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.530191    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 13 21:10:41.530402 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.530212    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 13 21:10:41.530402 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.530261    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 13 21:10:41.530402 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.530211    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 13 21:10:41.530402 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.530264    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 13 21:10:41.531236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.531018    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-d2n2uh3qnvr3l\""
Jul 13 21:10:41.531236 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.531119    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nnffh\""
Jul 13 21:10:41.537255 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.536764    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"]
Jul 13 21:10:41.648946 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.648910    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-tls\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.649120 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.648956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.649120 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.648981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw4mz\" (UniqueName: \"kubernetes.io/projected/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-kube-api-access-dw4mz\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.649120 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.649026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.649120 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.649060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-grpc-tls\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.649311 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.649139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.649311 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.649175    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.649311 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.649194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-metrics-client-ca\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.750655 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.750582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.750655 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.750619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-grpc-tls\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.750655 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.750652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.750906 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.750675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.750906 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.750692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-metrics-client-ca\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.750906 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.750731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-tls\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.750906 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.750754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.750906 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.750781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw4mz\" (UniqueName: \"kubernetes.io/projected/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-kube-api-access-dw4mz\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.751672 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.751618    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-metrics-client-ca\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.753815 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.753792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-grpc-tls\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.753906 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.753837    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.754022 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.753997    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-tls\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.754064 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.754045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.754145 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.754117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.754638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.754617    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.757768 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.757750    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw4mz\" (UniqueName: \"kubernetes.io/projected/40d88f3a-7e5f-4e9b-9ee8-e02545caae41-kube-api-access-dw4mz\") pod \"thanos-querier-6ccbdc876f-b4wzz\" (UID: \"40d88f3a-7e5f-4e9b-9ee8-e02545caae41\") " pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:41.840823 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:41.840788    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:43.221345 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.221077    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"]
Jul 13 21:10:43.260291 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.260211    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s5cvs"]
Jul 13 21:10:43.275656 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:43.273570    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b0bfb3_106f_4f8e_8a9e_8200729e2eaa.slice/crio-7001a1b29f74366bdc4fd2c9c0f524de5739609fb797f46010ba1dbd078ab0be WatchSource:0}: Error finding container 7001a1b29f74366bdc4fd2c9c0f524de5739609fb797f46010ba1dbd078ab0be: Status 404 returned error can't find the container with id 7001a1b29f74366bdc4fd2c9c0f524de5739609fb797f46010ba1dbd078ab0be
Jul 13 21:10:43.611021 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.610932    2580 patch_prober.go:28] interesting pod/image-registry-6b95f9f575-q56k9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 21:10:43.611021 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.610994    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9" podUID="f0e84464-f726-466c-b36a-f6718a50c0a4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:10:43.954265 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.953012    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"]
Jul 13 21:10:43.957819 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.956445    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:43.963569 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.958972    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 13 21:10:43.963569 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.959191    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-b7t7s\""
Jul 13 21:10:43.963569 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.959910    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-eh1r4g26418dq\""
Jul 13 21:10:43.963569 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.960113    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 13 21:10:43.963569 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.960291    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 13 21:10:43.967409 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.964433    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 13 21:10:43.967409 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:43.967063    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"]
Jul 13 21:10:44.079320 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.075206    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/de558037-7e02-41ef-bed8-e7775e8c5604-metrics-server-audit-profiles\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.079320 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.075286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/de558037-7e02-41ef-bed8-e7775e8c5604-audit-log\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.079320 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.075345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/de558037-7e02-41ef-bed8-e7775e8c5604-secret-metrics-server-client-certs\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.079320 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.075444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7szj\" (UniqueName: \"kubernetes.io/projected/de558037-7e02-41ef-bed8-e7775e8c5604-kube-api-access-l7szj\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.079320 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.075483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de558037-7e02-41ef-bed8-e7775e8c5604-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.079320 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.075593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/de558037-7e02-41ef-bed8-e7775e8c5604-secret-metrics-server-tls\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.079320 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.075677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de558037-7e02-41ef-bed8-e7775e8c5604-client-ca-bundle\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.103296 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.102779    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d5dcd874-gp886" event={"ID":"df89a8b7-a346-4b93-b30e-2f76e6325efb","Type":"ContainerStarted","Data":"3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb"}
Jul 13 21:10:44.107238 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.106563    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl" event={"ID":"14926375-8558-4cd8-a953-afca58bcaf40","Type":"ContainerStarted","Data":"327f4484af97d5b16dd1eabcecb1ea3f759ed67f6844dc0a97a594ddf0563616"}
Jul 13 21:10:44.107238 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.106633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl" event={"ID":"14926375-8558-4cd8-a953-afca58bcaf40","Type":"ContainerStarted","Data":"4e7d40cd9b1fa8ecf06ade4c8157b779f403c55fc869e183de0b67aaf4c6ba3c"}
Jul 13 21:10:44.107238 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.106664    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl" event={"ID":"14926375-8558-4cd8-a953-afca58bcaf40","Type":"ContainerStarted","Data":"6d4f3b097ac1e20ca896e4ae0810750e25387a400840d7b1f6f7be7c16be0947"}
Jul 13 21:10:44.109309 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.109279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz" event={"ID":"40d88f3a-7e5f-4e9b-9ee8-e02545caae41","Type":"ContainerStarted","Data":"5805da95cfaca4d53c436996227c98aae520b40b42379602c692ffaed0b32075"}
Jul 13 21:10:44.111714 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.111688    2580 generic.go:356] "Generic (PLEG): container finished" podID="65f81efa-d6fb-40dc-9d51-8ad043cf2f72" containerID="3864892c17567fc92b431e9e54657c4901613ef9b979ade0561291ec93259f7e" exitCode=0
Jul 13 21:10:44.111844 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.111774    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7kts5" event={"ID":"65f81efa-d6fb-40dc-9d51-8ad043cf2f72","Type":"ContainerDied","Data":"3864892c17567fc92b431e9e54657c4901613ef9b979ade0561291ec93259f7e"}
Jul 13 21:10:44.115607 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.115569    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s5cvs" event={"ID":"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa","Type":"ContainerStarted","Data":"7001a1b29f74366bdc4fd2c9c0f524de5739609fb797f46010ba1dbd078ab0be"}
Jul 13 21:10:44.120169 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.120074    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76d5dcd874-gp886" podStartSLOduration=1.77705369 podStartE2EDuration="6.120057197s" totalImagesPullingTime="4.343003507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:44.119126895 +0000 UTC m=+87.974271810" watchObservedRunningTime="2026-07-13 21:10:44.120057197 +0000 UTC m=+87.975202083"
Jul 13 21:10:44.135916 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.135860    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-skmnl" podStartSLOduration=2.122676468 podStartE2EDuration="5.135807479s" totalImagesPullingTime="3.013131011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:44.135714614 +0000 UTC m=+87.990859497" watchObservedRunningTime="2026-07-13 21:10:44.135807479 +0000 UTC m=+87.990952355"
Jul 13 21:10:44.177233 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.177204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7szj\" (UniqueName: \"kubernetes.io/projected/de558037-7e02-41ef-bed8-e7775e8c5604-kube-api-access-l7szj\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.177357 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.177254    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de558037-7e02-41ef-bed8-e7775e8c5604-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.177357 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.177315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/de558037-7e02-41ef-bed8-e7775e8c5604-secret-metrics-server-tls\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.177357 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.177339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de558037-7e02-41ef-bed8-e7775e8c5604-client-ca-bundle\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.177539 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.177519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/de558037-7e02-41ef-bed8-e7775e8c5604-metrics-server-audit-profiles\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.177613 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.177596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/de558037-7e02-41ef-bed8-e7775e8c5604-audit-log\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.177684 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.177669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/de558037-7e02-41ef-bed8-e7775e8c5604-secret-metrics-server-client-certs\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.179493 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.178827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de558037-7e02-41ef-bed8-e7775e8c5604-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.179689 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.179665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/de558037-7e02-41ef-bed8-e7775e8c5604-audit-log\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.180745 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.180639    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/de558037-7e02-41ef-bed8-e7775e8c5604-metrics-server-audit-profiles\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.181787 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.181742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de558037-7e02-41ef-bed8-e7775e8c5604-client-ca-bundle\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.182116 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.181961    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/de558037-7e02-41ef-bed8-e7775e8c5604-secret-metrics-server-client-certs\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.182835 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.182802    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/de558037-7e02-41ef-bed8-e7775e8c5604-secret-metrics-server-tls\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.187800 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.187747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7szj\" (UniqueName: \"kubernetes.io/projected/de558037-7e02-41ef-bed8-e7775e8c5604-kube-api-access-l7szj\") pod \"metrics-server-7d4fcd5566-vq7cw\" (UID: \"de558037-7e02-41ef-bed8-e7775e8c5604\") " pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.274342 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.274146    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:10:44.328246 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.328212    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"]
Jul 13 21:10:44.331778 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.331754    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"
Jul 13 21:10:44.333959 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.333934    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 13 21:10:44.334201 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.334175    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4whcf\""
Jul 13 21:10:44.340471 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.340453    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"]
Jul 13 21:10:44.466446 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.466211    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"]
Jul 13 21:10:44.481955 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.481795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tz45\" (UniqueName: \"kubernetes.io/projected/d692f271-582f-4613-9f9d-541ab066c257-kube-api-access-7tz45\") pod \"monitoring-plugin-5f68df7f58-rgv8h\" (UID: \"d692f271-582f-4613-9f9d-541ab066c257\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"
Jul 13 21:10:44.481955 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.481855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d692f271-582f-4613-9f9d-541ab066c257-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-rgv8h\" (UID: \"d692f271-582f-4613-9f9d-541ab066c257\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"
Jul 13 21:10:44.582499 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.582462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tz45\" (UniqueName: \"kubernetes.io/projected/d692f271-582f-4613-9f9d-541ab066c257-kube-api-access-7tz45\") pod \"monitoring-plugin-5f68df7f58-rgv8h\" (UID: \"d692f271-582f-4613-9f9d-541ab066c257\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"
Jul 13 21:10:44.582662 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.582536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d692f271-582f-4613-9f9d-541ab066c257-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-rgv8h\" (UID: \"d692f271-582f-4613-9f9d-541ab066c257\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"
Jul 13 21:10:44.582776 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:44.582753    2580 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 13 21:10:44.582899 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:10:44.582819    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d692f271-582f-4613-9f9d-541ab066c257-monitoring-plugin-cert podName:d692f271-582f-4613-9f9d-541ab066c257 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:45.082798929 +0000 UTC m=+88.937943793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d692f271-582f-4613-9f9d-541ab066c257-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-rgv8h" (UID: "d692f271-582f-4613-9f9d-541ab066c257") : secret "monitoring-plugin-cert" not found
Jul 13 21:10:44.590731 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:44.590706    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tz45\" (UniqueName: \"kubernetes.io/projected/d692f271-582f-4613-9f9d-541ab066c257-kube-api-access-7tz45\") pod \"monitoring-plugin-5f68df7f58-rgv8h\" (UID: \"d692f271-582f-4613-9f9d-541ab066c257\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"
Jul 13 21:10:45.088076 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.088039    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d692f271-582f-4613-9f9d-541ab066c257-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-rgv8h\" (UID: \"d692f271-582f-4613-9f9d-541ab066c257\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"
Jul 13 21:10:45.091658 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.091631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d692f271-582f-4613-9f9d-541ab066c257-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-rgv8h\" (UID: \"d692f271-582f-4613-9f9d-541ab066c257\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"
Jul 13 21:10:45.121087 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.121050    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw" event={"ID":"de558037-7e02-41ef-bed8-e7775e8c5604","Type":"ContainerStarted","Data":"29a1bb9fc8b2fe19686fc2a01a640591a597151fe3aedc84c634f83566876058"}
Jul 13 21:10:45.124204 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.124169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7kts5" event={"ID":"65f81efa-d6fb-40dc-9d51-8ad043cf2f72","Type":"ContainerStarted","Data":"fce224557beede92768d9173eced7c8165e8523e6af9d37f7980b564a091451f"}
Jul 13 21:10:45.124336 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.124242    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7kts5" event={"ID":"65f81efa-d6fb-40dc-9d51-8ad043cf2f72","Type":"ContainerStarted","Data":"6d0d0f79df030696a98c88b318127789605c47d5e2c88881a64a7c086bfa49ba"}
Jul 13 21:10:45.146908 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.146856    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7kts5" podStartSLOduration=3.487841966 podStartE2EDuration="6.146837141s" totalImagesPullingTime="2.548452462s" totalInitContainerRuntime="110.542713ms" isStatefulPod=true podCreationTimestamp="2026-07-13 21:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:45.144527837 +0000 UTC m=+88.999672732" watchObservedRunningTime="2026-07-13 21:10:45.146837141 +0000 UTC m=+89.001982036"
Jul 13 21:10:45.253971 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.253934    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"
Jul 13 21:10:45.764602 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.764564    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b95f9f575-q56k9"]
Jul 13 21:10:45.770355 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.770326    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:10:45.874040 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.872833    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f576f65d-xxsck"]
Jul 13 21:10:45.885634 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.884889    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:45.886629 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.886560    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f576f65d-xxsck"]
Jul 13 21:10:45.895445 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.895258    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 21:10:45.994994 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.994959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djsww\" (UniqueName: \"kubernetes.io/projected/fe361e25-0e4f-473a-86fa-b95750c6f4c5-kube-api-access-djsww\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:45.995176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.995027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-config\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:45.995176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.995094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-serving-cert\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:45.995176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.995116    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-service-ca\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:45.995176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.995142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-oauth-serving-cert\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:45.995176 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.995174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-oauth-config\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:45.995406 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:45.995199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-trusted-ca-bundle\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.096257 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.096174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-config\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.096257 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.096222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-serving-cert\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.096257 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.096241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-service-ca\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.096257 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.096257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-oauth-serving-cert\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.096609 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.096291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-oauth-config\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.096609 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.096319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-trusted-ca-bundle\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.096609 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.096405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djsww\" (UniqueName: \"kubernetes.io/projected/fe361e25-0e4f-473a-86fa-b95750c6f4c5-kube-api-access-djsww\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.097083 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.097027    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-service-ca\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.097083 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.097051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-config\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.097353 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.097304    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-oauth-serving-cert\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.097518 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.097489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-trusted-ca-bundle\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.099287 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.099244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-serving-cert\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.099629 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.099608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-oauth-config\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.103505 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.103487    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djsww\" (UniqueName: \"kubernetes.io/projected/fe361e25-0e4f-473a-86fa-b95750c6f4c5-kube-api-access-djsww\") pod \"console-59f576f65d-xxsck\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") " pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:46.198951 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:46.198916    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:48.507652 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:48.507618    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f576f65d-xxsck"]
Jul 13 21:10:48.513274 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:48.513225    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe361e25_0e4f_473a_86fa_b95750c6f4c5.slice/crio-5ea0eb40899a2959499050a81bcff9474714ca8eb3934dc7b258fbc3ee3c4174 WatchSource:0}: Error finding container 5ea0eb40899a2959499050a81bcff9474714ca8eb3934dc7b258fbc3ee3c4174: Status 404 returned error can't find the container with id 5ea0eb40899a2959499050a81bcff9474714ca8eb3934dc7b258fbc3ee3c4174
Jul 13 21:10:48.542515 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:48.542374    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"]
Jul 13 21:10:48.548325 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:10:48.548298    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd692f271_582f_4613_9f9d_541ab066c257.slice/crio-b279af421431f474405a452461e13894ece58fa57c6744a81f9566ee98f5c32b WatchSource:0}: Error finding container b279af421431f474405a452461e13894ece58fa57c6744a81f9566ee98f5c32b: Status 404 returned error can't find the container with id b279af421431f474405a452461e13894ece58fa57c6744a81f9566ee98f5c32b
Jul 13 21:10:48.586443 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:48.586406    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:48.586549 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:48.586466    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:48.592413 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:48.592336    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:49.143743 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:49.143482    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f576f65d-xxsck" event={"ID":"fe361e25-0e4f-473a-86fa-b95750c6f4c5","Type":"ContainerStarted","Data":"db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef"}
Jul 13 21:10:49.143743 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:49.143564    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f576f65d-xxsck" event={"ID":"fe361e25-0e4f-473a-86fa-b95750c6f4c5","Type":"ContainerStarted","Data":"5ea0eb40899a2959499050a81bcff9474714ca8eb3934dc7b258fbc3ee3c4174"}
Jul 13 21:10:49.144819 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:49.144776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h" event={"ID":"d692f271-582f-4613-9f9d-541ab066c257","Type":"ContainerStarted","Data":"b279af421431f474405a452461e13894ece58fa57c6744a81f9566ee98f5c32b"}
Jul 13 21:10:49.146494 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:49.146472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw" event={"ID":"de558037-7e02-41ef-bed8-e7775e8c5604","Type":"ContainerStarted","Data":"74170da6d50f398eea37f8bbcf2855ca98925ec4604795e772253667a18c87c9"}
Jul 13 21:10:49.148965 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:49.148938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz" event={"ID":"40d88f3a-7e5f-4e9b-9ee8-e02545caae41","Type":"ContainerStarted","Data":"e8b53fc1999950a85c506b0d5924939ba5c9cd10fdf91de6ca357b30c52eabf8"}
Jul 13 21:10:49.149063 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:49.149001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz" event={"ID":"40d88f3a-7e5f-4e9b-9ee8-e02545caae41","Type":"ContainerStarted","Data":"7dedec3d6acdf865af244e38827245ab4561a9cc348f10c669a61fe6b9a09464"}
Jul 13 21:10:49.149063 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:49.149045    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz" event={"ID":"40d88f3a-7e5f-4e9b-9ee8-e02545caae41","Type":"ContainerStarted","Data":"37d680e0257d952075e79d8fa8ca54fd2ee77b3d8c754333e2fd7f30a2ca6dab"}
Jul 13 21:10:49.150950 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:49.150930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s5cvs" event={"ID":"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa","Type":"ContainerStarted","Data":"2e98778b1719b7e15bc9b395c500e973ba3027ec3a11b1a0c426c46cace33198"}
Jul 13 21:10:49.151047 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:49.150969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s5cvs" event={"ID":"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa","Type":"ContainerStarted","Data":"07e70aac1c5a1c21b02951ff60ad6d851bce67f417e3933752eb02c49b0a0809"}
Jul 13 21:10:49.155369 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:49.155346    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:10:49.161473 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:49.161423    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59f576f65d-xxsck" podStartSLOduration=4.161404829 podStartE2EDuration="4.161404829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:49.160673587 +0000 UTC m=+93.015818470" watchObservedRunningTime="2026-07-13 21:10:49.161404829 +0000 UTC m=+93.016549711"
Jul 13 21:10:49.177627 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:49.177574    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw" podStartSLOduration=2.301134049 podStartE2EDuration="6.177556593s" totalImagesPullingTime="3.876422544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:49.175540715 +0000 UTC m=+93.030685597" watchObservedRunningTime="2026-07-13 21:10:49.177556593 +0000 UTC m=+93.032701478"
Jul 13 21:10:50.162913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:50.162459    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz" event={"ID":"40d88f3a-7e5f-4e9b-9ee8-e02545caae41","Type":"ContainerStarted","Data":"9943927497a7f82ef6e23fce92c81bce61adb6881c7290121edf6bed7f836863"}
Jul 13 21:10:50.164723 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:50.164652    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz" event={"ID":"40d88f3a-7e5f-4e9b-9ee8-e02545caae41","Type":"ContainerStarted","Data":"d36421be4ac777d3a1029d1e51adb197e2e915e63c70335ab79677ef1a5ea20d"}
Jul 13 21:10:50.164835 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:50.164815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz" event={"ID":"40d88f3a-7e5f-4e9b-9ee8-e02545caae41","Type":"ContainerStarted","Data":"813ebabdb28889a001e527bde59cc9b34aa101d7f46c777c9f07840ad8090649"}
Jul 13 21:10:50.165235 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:50.165210    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:50.187965 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:50.187917    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz" podStartSLOduration=3.241029293 podStartE2EDuration="9.187896921s" totalImagesPullingTime="5.946867628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:50.185258593 +0000 UTC m=+94.040403476" watchObservedRunningTime="2026-07-13 21:10:50.187896921 +0000 UTC m=+94.043041809"
Jul 13 21:10:51.168750 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:51.168651    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h" event={"ID":"d692f271-582f-4613-9f9d-541ab066c257","Type":"ContainerStarted","Data":"6361964fbee220cd0c143fe05888383fe0fd8c263d9318f5ade25a89d7700ad0"}
Jul 13 21:10:51.168750 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:51.168717    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"
Jul 13 21:10:51.174532 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:51.174482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h"
Jul 13 21:10:51.184082 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:51.184030    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rgv8h" podStartSLOduration=5.596419808 podStartE2EDuration="7.184016867s" totalImagesPullingTime="1.587597059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:51.182714182 +0000 UTC m=+95.037859060" watchObservedRunningTime="2026-07-13 21:10:51.184016867 +0000 UTC m=+95.039161826"
Jul 13 21:10:52.174760 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:52.174720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s5cvs" event={"ID":"68b0bfb3-106f-4f8e-8a9e-8200729e2eaa","Type":"ContainerStarted","Data":"49e1ab40936dea1a7b3cc9800f09bf7fc66373d20ffd666a9ec9ee86b404e316"}
Jul 13 21:10:52.191797 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:52.191745    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s5cvs" podStartSLOduration=10.975422342 podStartE2EDuration="19.191729167s" totalImagesPullingTime="8.216306825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:10:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:52.189731705 +0000 UTC m=+96.044876586" watchObservedRunningTime="2026-07-13 21:10:52.191729167 +0000 UTC m=+96.046874049"
Jul 13 21:10:56.175117 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:56.175090    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6ccbdc876f-b4wzz"
Jul 13 21:10:56.199188 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:56.199157    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:56.199568 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:56.199535    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:56.203938 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:56.203916    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:57.196163 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:57.196137    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:10:57.238550 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:10:57.238513    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76d5dcd874-gp886"]
Jul 13 21:11:02.855890 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:02.855837    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69568597b8-pnlsn"]
Jul 13 21:11:02.890898 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:02.890865    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69568597b8-pnlsn"]
Jul 13 21:11:02.891042 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:02.890951    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:02.949256 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:02.949224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-oauth-config\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:02.949502 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:02.949480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-service-ca\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:02.949967 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:02.949621    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-serving-cert\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:02.949967 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:02.949699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blfjw\" (UniqueName: \"kubernetes.io/projected/8174428d-6c9a-43b0-9fbc-04140dbb6620-kube-api-access-blfjw\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:02.949967 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:02.949726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-config\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:02.949967 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:02.949814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-trusted-ca-bundle\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:02.949967 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:02.949865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-oauth-serving-cert\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.050832 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.050809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-oauth-config\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.050954 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.050842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-service-ca\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.050954 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.050875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-serving-cert\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.050954 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.050905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blfjw\" (UniqueName: \"kubernetes.io/projected/8174428d-6c9a-43b0-9fbc-04140dbb6620-kube-api-access-blfjw\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.050954 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.050931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-config\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.051192 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.051165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-trusted-ca-bundle\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.051252 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.051235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-oauth-serving-cert\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.051644 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.051621    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-service-ca\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.051733 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.051699    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-config\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.051941 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.051918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-oauth-serving-cert\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.052252 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.052226    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-trusted-ca-bundle\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.053328 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.053312    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-oauth-config\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.053511 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.053496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-serving-cert\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.060159 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.060141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blfjw\" (UniqueName: \"kubernetes.io/projected/8174428d-6c9a-43b0-9fbc-04140dbb6620-kube-api-access-blfjw\") pod \"console-69568597b8-pnlsn\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") " pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.199171 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.199141    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:03.377259 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:03.377230    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69568597b8-pnlsn"]
Jul 13 21:11:03.379804 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:11:03.379776    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8174428d_6c9a_43b0_9fbc_04140dbb6620.slice/crio-8148140735dbf6e835899602e59f81c97d55a416a8a972c1a1dcc7ec777fbfce WatchSource:0}: Error finding container 8148140735dbf6e835899602e59f81c97d55a416a8a972c1a1dcc7ec777fbfce: Status 404 returned error can't find the container with id 8148140735dbf6e835899602e59f81c97d55a416a8a972c1a1dcc7ec777fbfce
Jul 13 21:11:04.062851 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:04.062824    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2d9kz"
Jul 13 21:11:04.220425 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:04.220395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69568597b8-pnlsn" event={"ID":"8174428d-6c9a-43b0-9fbc-04140dbb6620","Type":"ContainerStarted","Data":"f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807"}
Jul 13 21:11:04.220582 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:04.220441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69568597b8-pnlsn" event={"ID":"8174428d-6c9a-43b0-9fbc-04140dbb6620","Type":"ContainerStarted","Data":"8148140735dbf6e835899602e59f81c97d55a416a8a972c1a1dcc7ec777fbfce"}
Jul 13 21:11:04.236592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:04.236539    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69568597b8-pnlsn" podStartSLOduration=2.236521452 podStartE2EDuration="2.236521452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:04.235288299 +0000 UTC m=+108.090433176" watchObservedRunningTime="2026-07-13 21:11:04.236521452 +0000 UTC m=+108.091666336"
Jul 13 21:11:04.275566 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:04.275537    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:11:04.275697 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:04.275601    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:11:10.794188 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:10.794145    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9" podUID="f0e84464-f726-466c-b36a-f6718a50c0a4" containerName="registry" containerID="cri-o://d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26" gracePeriod=30
Jul 13 21:11:11.040538 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.040512    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:11:11.110638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.110578    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0e84464-f726-466c-b36a-f6718a50c0a4-trusted-ca\") pod \"f0e84464-f726-466c-b36a-f6718a50c0a4\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") "
Jul 13 21:11:11.110638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.110612    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-certificates\") pod \"f0e84464-f726-466c-b36a-f6718a50c0a4\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") "
Jul 13 21:11:11.110845 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.110658    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0e84464-f726-466c-b36a-f6718a50c0a4-image-registry-private-configuration\") pod \"f0e84464-f726-466c-b36a-f6718a50c0a4\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") "
Jul 13 21:11:11.110845 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.110686    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls\") pod \"f0e84464-f726-466c-b36a-f6718a50c0a4\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") "
Jul 13 21:11:11.110845 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.110703    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zdrh\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-kube-api-access-2zdrh\") pod \"f0e84464-f726-466c-b36a-f6718a50c0a4\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") "
Jul 13 21:11:11.110845 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.110731    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-bound-sa-token\") pod \"f0e84464-f726-466c-b36a-f6718a50c0a4\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") "
Jul 13 21:11:11.110845 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.110761    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0e84464-f726-466c-b36a-f6718a50c0a4-ca-trust-extracted\") pod \"f0e84464-f726-466c-b36a-f6718a50c0a4\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") "
Jul 13 21:11:11.110845 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.110783    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0e84464-f726-466c-b36a-f6718a50c0a4-installation-pull-secrets\") pod \"f0e84464-f726-466c-b36a-f6718a50c0a4\" (UID: \"f0e84464-f726-466c-b36a-f6718a50c0a4\") "
Jul 13 21:11:11.111135 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.111079    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0e84464-f726-466c-b36a-f6718a50c0a4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f0e84464-f726-466c-b36a-f6718a50c0a4" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:11:11.111427 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.111370    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f0e84464-f726-466c-b36a-f6718a50c0a4" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:11:11.113527 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.113494    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f0e84464-f726-466c-b36a-f6718a50c0a4" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:11:11.113637 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.113494    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e84464-f726-466c-b36a-f6718a50c0a4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f0e84464-f726-466c-b36a-f6718a50c0a4" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:11:11.113637 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.113567    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f0e84464-f726-466c-b36a-f6718a50c0a4" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:11:11.113637 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.113602    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e84464-f726-466c-b36a-f6718a50c0a4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f0e84464-f726-466c-b36a-f6718a50c0a4" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:11:11.113750 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.113636    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-kube-api-access-2zdrh" (OuterVolumeSpecName: "kube-api-access-2zdrh") pod "f0e84464-f726-466c-b36a-f6718a50c0a4" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4"). InnerVolumeSpecName "kube-api-access-2zdrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:11:11.121906 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.121879    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0e84464-f726-466c-b36a-f6718a50c0a4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f0e84464-f726-466c-b36a-f6718a50c0a4" (UID: "f0e84464-f726-466c-b36a-f6718a50c0a4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:11:11.212178 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.212153    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0e84464-f726-466c-b36a-f6718a50c0a4-installation-pull-secrets\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:11.212178 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.212174    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0e84464-f726-466c-b36a-f6718a50c0a4-trusted-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:11.212309 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.212184    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-certificates\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:11.212309 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.212196    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0e84464-f726-466c-b36a-f6718a50c0a4-image-registry-private-configuration\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:11.212309 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.212204    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-registry-tls\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:11.212309 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.212212    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zdrh\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-kube-api-access-2zdrh\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:11.212309 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.212221    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0e84464-f726-466c-b36a-f6718a50c0a4-bound-sa-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:11.212309 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.212229    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0e84464-f726-466c-b36a-f6718a50c0a4-ca-trust-extracted\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:11.248217 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.248186    2580 generic.go:356] "Generic (PLEG): container finished" podID="f0e84464-f726-466c-b36a-f6718a50c0a4" containerID="d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26" exitCode=0
Jul 13 21:11:11.248324 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.248236    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9"
Jul 13 21:11:11.248324 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.248284    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9" event={"ID":"f0e84464-f726-466c-b36a-f6718a50c0a4","Type":"ContainerDied","Data":"d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26"}
Jul 13 21:11:11.248475 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.248344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b95f9f575-q56k9" event={"ID":"f0e84464-f726-466c-b36a-f6718a50c0a4","Type":"ContainerDied","Data":"b730c4ad78a01b8c512d3f7b1d020835d54075422904e47f4b35424d41eb3608"}
Jul 13 21:11:11.248475 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.248376    2580 scope.go:117] "RemoveContainer" containerID="d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26"
Jul 13 21:11:11.257040 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.257024    2580 scope.go:117] "RemoveContainer" containerID="d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26"
Jul 13 21:11:11.257319 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:11:11.257299    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26\": container with ID starting with d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26 not found: ID does not exist" containerID="d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26"
Jul 13 21:11:11.257365 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.257328    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26"} err="failed to get container status \"d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26\": rpc error: code = NotFound desc = could not find container \"d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26\": container with ID starting with d28cf3ba6ab11248db0acf6ee9f5368f867b9ae5ab08d1a21dd2a815a3612e26 not found: ID does not exist"
Jul 13 21:11:11.267876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.267854    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b95f9f575-q56k9"]
Jul 13 21:11:11.279410 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:11.278646    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b95f9f575-q56k9"]
Jul 13 21:11:12.713262 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:12.713225    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0e84464-f726-466c-b36a-f6718a50c0a4" path="/var/lib/kubelet/pods/f0e84464-f726-466c-b36a-f6718a50c0a4/volumes"
Jul 13 21:11:13.199715 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:13.199683    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:13.199880 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:13.199734    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:13.204424 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:13.204403    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:13.260235 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:13.260211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:11:13.304915 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:13.304883    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f576f65d-xxsck"]
Jul 13 21:11:22.261351 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:22.261297    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76d5dcd874-gp886" podUID="df89a8b7-a346-4b93-b30e-2f76e6325efb" containerName="console" containerID="cri-o://3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb" gracePeriod=15
Jul 13 21:11:23.068184 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.068157    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:11:23.107391 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.107365    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-serving-cert\") pod \"df89a8b7-a346-4b93-b30e-2f76e6325efb\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") "
Jul 13 21:11:23.107539 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.107420    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-oauth-config\") pod \"df89a8b7-a346-4b93-b30e-2f76e6325efb\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") "
Jul 13 21:11:23.107539 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.107442    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44nfr\" (UniqueName: \"kubernetes.io/projected/df89a8b7-a346-4b93-b30e-2f76e6325efb-kube-api-access-44nfr\") pod \"df89a8b7-a346-4b93-b30e-2f76e6325efb\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") "
Jul 13 21:11:23.107539 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.107461    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-oauth-serving-cert\") pod \"df89a8b7-a346-4b93-b30e-2f76e6325efb\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") "
Jul 13 21:11:23.107539 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.107485    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-service-ca\") pod \"df89a8b7-a346-4b93-b30e-2f76e6325efb\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") "
Jul 13 21:11:23.107539 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.107511    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-config\") pod \"df89a8b7-a346-4b93-b30e-2f76e6325efb\" (UID: \"df89a8b7-a346-4b93-b30e-2f76e6325efb\") "
Jul 13 21:11:23.107974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.107944    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "df89a8b7-a346-4b93-b30e-2f76e6325efb" (UID: "df89a8b7-a346-4b93-b30e-2f76e6325efb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:11:23.107974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.107958    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-config" (OuterVolumeSpecName: "console-config") pod "df89a8b7-a346-4b93-b30e-2f76e6325efb" (UID: "df89a8b7-a346-4b93-b30e-2f76e6325efb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:11:23.108141 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.107971    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-service-ca" (OuterVolumeSpecName: "service-ca") pod "df89a8b7-a346-4b93-b30e-2f76e6325efb" (UID: "df89a8b7-a346-4b93-b30e-2f76e6325efb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:11:23.109614 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.109584    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "df89a8b7-a346-4b93-b30e-2f76e6325efb" (UID: "df89a8b7-a346-4b93-b30e-2f76e6325efb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:11:23.109736 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.109716    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "df89a8b7-a346-4b93-b30e-2f76e6325efb" (UID: "df89a8b7-a346-4b93-b30e-2f76e6325efb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:11:23.109804 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.109786    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df89a8b7-a346-4b93-b30e-2f76e6325efb-kube-api-access-44nfr" (OuterVolumeSpecName: "kube-api-access-44nfr") pod "df89a8b7-a346-4b93-b30e-2f76e6325efb" (UID: "df89a8b7-a346-4b93-b30e-2f76e6325efb"). InnerVolumeSpecName "kube-api-access-44nfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:11:23.208414 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.208332    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-serving-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:23.208414 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.208354    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-oauth-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:23.208414 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.208362    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44nfr\" (UniqueName: \"kubernetes.io/projected/df89a8b7-a346-4b93-b30e-2f76e6325efb-kube-api-access-44nfr\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:23.208414 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.208371    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-oauth-serving-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:23.208414 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.208404    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:23.208414 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.208418    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df89a8b7-a346-4b93-b30e-2f76e6325efb-console-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:23.293785 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.293754    2580 generic.go:356] "Generic (PLEG): container finished" podID="df89a8b7-a346-4b93-b30e-2f76e6325efb" containerID="3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb" exitCode=0
Jul 13 21:11:23.294117 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.293799    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d5dcd874-gp886"
Jul 13 21:11:23.294117 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.293843    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d5dcd874-gp886" event={"ID":"df89a8b7-a346-4b93-b30e-2f76e6325efb","Type":"ContainerDied","Data":"3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb"}
Jul 13 21:11:23.294117 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.293893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d5dcd874-gp886" event={"ID":"df89a8b7-a346-4b93-b30e-2f76e6325efb","Type":"ContainerDied","Data":"e6a39ea959355d1f25ebda84716bf672189f8f7e559bde7117c72e0258d025b3"}
Jul 13 21:11:23.294117 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.293914    2580 scope.go:117] "RemoveContainer" containerID="3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb"
Jul 13 21:11:23.303984 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.303967    2580 scope.go:117] "RemoveContainer" containerID="3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb"
Jul 13 21:11:23.304217 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:11:23.304195    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb\": container with ID starting with 3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb not found: ID does not exist" containerID="3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb"
Jul 13 21:11:23.304291 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.304227    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb"} err="failed to get container status \"3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb\": rpc error: code = NotFound desc = could not find container \"3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb\": container with ID starting with 3be8c21dbead3ed564ce51d7dd8c01ba2e4040a87eec84109f2d78f21521cfdb not found: ID does not exist"
Jul 13 21:11:23.315135 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.315114    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76d5dcd874-gp886"]
Jul 13 21:11:23.317909 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:23.317889    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76d5dcd874-gp886"]
Jul 13 21:11:24.280393 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:24.280344    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:11:24.284261 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:24.284240    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d4fcd5566-vq7cw"
Jul 13 21:11:24.712871 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:24.712829    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df89a8b7-a346-4b93-b30e-2f76e6325efb" path="/var/lib/kubelet/pods/df89a8b7-a346-4b93-b30e-2f76e6325efb/volumes"
Jul 13 21:11:38.334088 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.334005    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59f576f65d-xxsck" podUID="fe361e25-0e4f-473a-86fa-b95750c6f4c5" containerName="console" containerID="cri-o://db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef" gracePeriod=15
Jul 13 21:11:38.571145 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.571119    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:11:38.727144 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.727113    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-trusted-ca-bundle\") pod \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") "
Jul 13 21:11:38.727144 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.727145    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-oauth-config\") pod \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") "
Jul 13 21:11:38.727373 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.727166    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-serving-cert\") pod \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") "
Jul 13 21:11:38.727373 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.727224    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-config\") pod \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") "
Jul 13 21:11:38.727373 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.727240    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-service-ca\") pod \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") "
Jul 13 21:11:38.727373 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.727268    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djsww\" (UniqueName: \"kubernetes.io/projected/fe361e25-0e4f-473a-86fa-b95750c6f4c5-kube-api-access-djsww\") pod \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") "
Jul 13 21:11:38.727373 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.727283    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-oauth-serving-cert\") pod \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\" (UID: \"fe361e25-0e4f-473a-86fa-b95750c6f4c5\") "
Jul 13 21:11:38.727686 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.727604    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fe361e25-0e4f-473a-86fa-b95750c6f4c5" (UID: "fe361e25-0e4f-473a-86fa-b95750c6f4c5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:11:38.727749 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.727712    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-service-ca" (OuterVolumeSpecName: "service-ca") pod "fe361e25-0e4f-473a-86fa-b95750c6f4c5" (UID: "fe361e25-0e4f-473a-86fa-b95750c6f4c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:11:38.727749 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.727729    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-config" (OuterVolumeSpecName: "console-config") pod "fe361e25-0e4f-473a-86fa-b95750c6f4c5" (UID: "fe361e25-0e4f-473a-86fa-b95750c6f4c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:11:38.727860 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.727798    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fe361e25-0e4f-473a-86fa-b95750c6f4c5" (UID: "fe361e25-0e4f-473a-86fa-b95750c6f4c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:11:38.729451 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.729427    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fe361e25-0e4f-473a-86fa-b95750c6f4c5" (UID: "fe361e25-0e4f-473a-86fa-b95750c6f4c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:11:38.729526 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.729470    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fe361e25-0e4f-473a-86fa-b95750c6f4c5" (UID: "fe361e25-0e4f-473a-86fa-b95750c6f4c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:11:38.729602 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.729584    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe361e25-0e4f-473a-86fa-b95750c6f4c5-kube-api-access-djsww" (OuterVolumeSpecName: "kube-api-access-djsww") pod "fe361e25-0e4f-473a-86fa-b95750c6f4c5" (UID: "fe361e25-0e4f-473a-86fa-b95750c6f4c5"). InnerVolumeSpecName "kube-api-access-djsww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:11:38.828371 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.828343    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:38.828371 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.828365    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:38.828541 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.828375    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djsww\" (UniqueName: \"kubernetes.io/projected/fe361e25-0e4f-473a-86fa-b95750c6f4c5-kube-api-access-djsww\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:38.828541 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.828403    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-oauth-serving-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:38.828541 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.828411    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe361e25-0e4f-473a-86fa-b95750c6f4c5-trusted-ca-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:38.828541 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.828419    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-oauth-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:38.828541 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:38.828427    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe361e25-0e4f-473a-86fa-b95750c6f4c5-console-serving-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:11:39.355158 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:39.355124    2580 generic.go:356] "Generic (PLEG): container finished" podID="fe361e25-0e4f-473a-86fa-b95750c6f4c5" containerID="db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef" exitCode=0
Jul 13 21:11:39.355158 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:39.355162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f576f65d-xxsck" event={"ID":"fe361e25-0e4f-473a-86fa-b95750c6f4c5","Type":"ContainerDied","Data":"db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef"}
Jul 13 21:11:39.355639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:39.355172    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f576f65d-xxsck"
Jul 13 21:11:39.355639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:39.355202    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f576f65d-xxsck" event={"ID":"fe361e25-0e4f-473a-86fa-b95750c6f4c5","Type":"ContainerDied","Data":"5ea0eb40899a2959499050a81bcff9474714ca8eb3934dc7b258fbc3ee3c4174"}
Jul 13 21:11:39.355639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:39.355222    2580 scope.go:117] "RemoveContainer" containerID="db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef"
Jul 13 21:11:39.364277 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:39.364259    2580 scope.go:117] "RemoveContainer" containerID="db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef"
Jul 13 21:11:39.364580 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:11:39.364544    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef\": container with ID starting with db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef not found: ID does not exist" containerID="db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef"
Jul 13 21:11:39.364667 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:39.364587    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef"} err="failed to get container status \"db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef\": rpc error: code = NotFound desc = could not find container \"db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef\": container with ID starting with db33d09c6dd1b77c3e0c7b2a5ddedaef06c6c37c38658716404fee7e4844cbef not found: ID does not exist"
Jul 13 21:11:39.376300 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:39.376275    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f576f65d-xxsck"]
Jul 13 21:11:39.381637 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:39.381617    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59f576f65d-xxsck"]
Jul 13 21:11:40.712644 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:11:40.712613    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe361e25-0e4f-473a-86fa-b95750c6f4c5" path="/var/lib/kubelet/pods/fe361e25-0e4f-473a-86fa-b95750c6f4c5/volumes"
Jul 13 21:12:01.285245 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.285208    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 21:12:01.285693 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.285589    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df89a8b7-a346-4b93-b30e-2f76e6325efb" containerName="console"
Jul 13 21:12:01.285693 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.285601    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="df89a8b7-a346-4b93-b30e-2f76e6325efb" containerName="console"
Jul 13 21:12:01.285693 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.285612    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0e84464-f726-466c-b36a-f6718a50c0a4" containerName="registry"
Jul 13 21:12:01.285693 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.285619    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0e84464-f726-466c-b36a-f6718a50c0a4" containerName="registry"
Jul 13 21:12:01.285693 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.285636    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe361e25-0e4f-473a-86fa-b95750c6f4c5" containerName="console"
Jul 13 21:12:01.285693 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.285642    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe361e25-0e4f-473a-86fa-b95750c6f4c5" containerName="console"
Jul 13 21:12:01.285693 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.285688    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0e84464-f726-466c-b36a-f6718a50c0a4" containerName="registry"
Jul 13 21:12:01.285693 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.285696    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="df89a8b7-a346-4b93-b30e-2f76e6325efb" containerName="console"
Jul 13 21:12:01.285964 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.285701    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe361e25-0e4f-473a-86fa-b95750c6f4c5" containerName="console"
Jul 13 21:12:01.289131 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.289111    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.291311 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.291284    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lcxxm\""
Jul 13 21:12:01.291458 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.291352    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 21:12:01.291596 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.291575    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 21:12:01.291690 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.291576    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 21:12:01.291690 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.291670    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 21:12:01.291795 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.291762    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 21:12:01.292064 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.292047    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 21:12:01.292131 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.292081    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 21:12:01.292279 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.292266    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 21:12:01.298558 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.298535    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 21:12:01.306652 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.306628    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 21:12:01.412251 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32432980-45f0-41ba-aeb3-ab6b7e1950cd-config-out\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.412251 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-config-volume\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.412489 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412275    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-web-config\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.412489 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412292    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32432980-45f0-41ba-aeb3-ab6b7e1950cd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.412489 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/32432980-45f0-41ba-aeb3-ab6b7e1950cd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.412489 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412377    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.412489 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32432980-45f0-41ba-aeb3-ab6b7e1950cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.412489 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.412675 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.412675 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32432980-45f0-41ba-aeb3-ab6b7e1950cd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.412675 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.412675 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5wqd\" (UniqueName: \"kubernetes.io/projected/32432980-45f0-41ba-aeb3-ab6b7e1950cd-kube-api-access-w5wqd\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.412675 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.412616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.513741 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.513704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.513899 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.513750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32432980-45f0-41ba-aeb3-ab6b7e1950cd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.513899 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.513875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.513979 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.513917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5wqd\" (UniqueName: \"kubernetes.io/projected/32432980-45f0-41ba-aeb3-ab6b7e1950cd-kube-api-access-w5wqd\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.513979 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.513949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.514086 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.514005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32432980-45f0-41ba-aeb3-ab6b7e1950cd-config-out\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.514086 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.514043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-config-volume\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.514086 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.514073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-web-config\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.514215 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.514097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32432980-45f0-41ba-aeb3-ab6b7e1950cd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.514215 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.514139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/32432980-45f0-41ba-aeb3-ab6b7e1950cd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.514215 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.514174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.514215 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.514196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32432980-45f0-41ba-aeb3-ab6b7e1950cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.514427 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.514237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.514570 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.514538    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32432980-45f0-41ba-aeb3-ab6b7e1950cd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.516110 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.515637    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32432980-45f0-41ba-aeb3-ab6b7e1950cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.516630 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.516603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/32432980-45f0-41ba-aeb3-ab6b7e1950cd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.516924 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.516907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-config-volume\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.517039 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.517018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.517312 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.517291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.517471 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.517452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-web-config\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.517515 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.517452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.517838 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.517813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32432980-45f0-41ba-aeb3-ab6b7e1950cd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.517945 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.517886    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.518356 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.518338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32432980-45f0-41ba-aeb3-ab6b7e1950cd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.518464 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.518446    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32432980-45f0-41ba-aeb3-ab6b7e1950cd-config-out\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.521455 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.521437    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5wqd\" (UniqueName: \"kubernetes.io/projected/32432980-45f0-41ba-aeb3-ab6b7e1950cd-kube-api-access-w5wqd\") pod \"alertmanager-main-0\" (UID: \"32432980-45f0-41ba-aeb3-ab6b7e1950cd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.599411 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.599311    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:12:01.737791 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:01.737761    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 21:12:01.740981 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:12:01.740914    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32432980_45f0_41ba_aeb3_ab6b7e1950cd.slice/crio-686ae8185d651b9e70d5a01d315b9142400c4d01753e8c997b23d7d586e96405 WatchSource:0}: Error finding container 686ae8185d651b9e70d5a01d315b9142400c4d01753e8c997b23d7d586e96405: Status 404 returned error can't find the container with id 686ae8185d651b9e70d5a01d315b9142400c4d01753e8c997b23d7d586e96405
Jul 13 21:12:02.439041 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:02.439003    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32432980-45f0-41ba-aeb3-ab6b7e1950cd","Type":"ContainerStarted","Data":"686ae8185d651b9e70d5a01d315b9142400c4d01753e8c997b23d7d586e96405"}
Jul 13 21:12:03.444267 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:03.444237    2580 generic.go:356] "Generic (PLEG): container finished" podID="32432980-45f0-41ba-aeb3-ab6b7e1950cd" containerID="6d1ec1845b1e81c79e53cc3f58539fe1d3df4434dda8aacf4cf16e1628edcda1" exitCode=0
Jul 13 21:12:03.444645 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:03.444321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32432980-45f0-41ba-aeb3-ab6b7e1950cd","Type":"ContainerDied","Data":"6d1ec1845b1e81c79e53cc3f58539fe1d3df4434dda8aacf4cf16e1628edcda1"}
Jul 13 21:12:05.158679 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.158644    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7999d85f49-f2fgr"]
Jul 13 21:12:05.161277 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.161239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.179082 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.179053    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7999d85f49-f2fgr"]
Jul 13 21:12:05.243136 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.243098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-trusted-ca-bundle\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.243300 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.243145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq4tz\" (UniqueName: \"kubernetes.io/projected/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-kube-api-access-mq4tz\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.243300 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.243178    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-config\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.243300 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.243230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-serving-cert\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.243300 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.243258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-oauth-serving-cert\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.243300 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.243281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-service-ca\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.243558 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.243419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-oauth-config\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.344549 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.344518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-oauth-config\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.344717 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.344563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-trusted-ca-bundle\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.344717 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.344602    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq4tz\" (UniqueName: \"kubernetes.io/projected/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-kube-api-access-mq4tz\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.344717 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.344626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-config\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.344717 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.344653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-serving-cert\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.344717 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.344673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-oauth-serving-cert\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.344717 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.344692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-service-ca\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.350879 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.345746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-config\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.350879 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.345769    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-oauth-serving-cert\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.350879 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.345889    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-service-ca\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.350879 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.345999    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-trusted-ca-bundle\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.350879 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.347861    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-serving-cert\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.350879 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.347894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-oauth-config\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.357518 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.357493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq4tz\" (UniqueName: \"kubernetes.io/projected/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-kube-api-access-mq4tz\") pod \"console-7999d85f49-f2fgr\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") " pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.473684 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.473607    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:05.612333 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:05.612202    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7999d85f49-f2fgr"]
Jul 13 21:12:05.615265 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:12:05.615240    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5dbad58_ce9e_4189_8e44_5913ec3c7a59.slice/crio-2959d82bbc7343f316004be806181cf795b14e2f8eea4929e2cd049a17f6a1fd WatchSource:0}: Error finding container 2959d82bbc7343f316004be806181cf795b14e2f8eea4929e2cd049a17f6a1fd: Status 404 returned error can't find the container with id 2959d82bbc7343f316004be806181cf795b14e2f8eea4929e2cd049a17f6a1fd
Jul 13 21:12:06.459990 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:06.459963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32432980-45f0-41ba-aeb3-ab6b7e1950cd","Type":"ContainerStarted","Data":"977c1b61338b0608fd4c426e4513573424c85817e2af06b852d50805d551a21a"}
Jul 13 21:12:06.461563 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:06.461538    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7999d85f49-f2fgr" event={"ID":"e5dbad58-ce9e-4189-8e44-5913ec3c7a59","Type":"ContainerStarted","Data":"3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2"}
Jul 13 21:12:06.461666 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:06.461575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7999d85f49-f2fgr" event={"ID":"e5dbad58-ce9e-4189-8e44-5913ec3c7a59","Type":"ContainerStarted","Data":"2959d82bbc7343f316004be806181cf795b14e2f8eea4929e2cd049a17f6a1fd"}
Jul 13 21:12:06.478703 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:06.478656    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7999d85f49-f2fgr" podStartSLOduration=1.478641045 podStartE2EDuration="1.478641045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:12:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:06.476634467 +0000 UTC m=+170.331779351" watchObservedRunningTime="2026-07-13 21:12:06.478641045 +0000 UTC m=+170.333785926"
Jul 13 21:12:07.471396 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:07.471337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32432980-45f0-41ba-aeb3-ab6b7e1950cd","Type":"ContainerStarted","Data":"ab92ea57f21830e0f33b36c48f40f1a08f9794b59c042b0aac271355c829a91f"}
Jul 13 21:12:07.471768 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:07.471438    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32432980-45f0-41ba-aeb3-ab6b7e1950cd","Type":"ContainerStarted","Data":"b5d9efcaddca35e52fc65c221a2e8e229f9d50549b27d58749605aea2b488f32"}
Jul 13 21:12:07.471768 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:07.471483    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32432980-45f0-41ba-aeb3-ab6b7e1950cd","Type":"ContainerStarted","Data":"fe54d8b10d6b2ffde4a60b12b82e9562ff33ddd25b1911cae3f5b7ed914c7cc0"}
Jul 13 21:12:07.471768 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:07.471523    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32432980-45f0-41ba-aeb3-ab6b7e1950cd","Type":"ContainerStarted","Data":"a8200f7a86f1ca43530f97a3789a8a3720c1ce964bf1e1a91796cfa720b43dea"}
Jul 13 21:12:07.471768 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:07.471557    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32432980-45f0-41ba-aeb3-ab6b7e1950cd","Type":"ContainerStarted","Data":"91a2b4e728757052c705ad8da5312141bfd23b7182d8e590564b842d0249cfcc"}
Jul 13 21:12:07.495545 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:07.495494    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.411923535 podStartE2EDuration="6.495479302s" totalImagesPullingTime="4.064289697s" totalInitContainerRuntime="19.26607ms" isStatefulPod=false podCreationTimestamp="2026-07-13 21:12:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:07.493646399 +0000 UTC m=+171.348791276" watchObservedRunningTime="2026-07-13 21:12:07.495479302 +0000 UTC m=+171.350624184"
Jul 13 21:12:15.473969 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:15.473885    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:15.473969 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:15.473945    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:15.478688 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:15.478667    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:15.509839 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:15.509810    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:12:15.547834 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:15.547803    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69568597b8-pnlsn"]
Jul 13 21:12:40.571203 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.571153    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69568597b8-pnlsn" podUID="8174428d-6c9a-43b0-9fbc-04140dbb6620" containerName="console" containerID="cri-o://f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807" gracePeriod=15
Jul 13 21:12:40.819246 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.819222    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:12:40.960960 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.960924    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-serving-cert\") pod \"8174428d-6c9a-43b0-9fbc-04140dbb6620\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") "
Jul 13 21:12:40.960960 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.960961    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blfjw\" (UniqueName: \"kubernetes.io/projected/8174428d-6c9a-43b0-9fbc-04140dbb6620-kube-api-access-blfjw\") pod \"8174428d-6c9a-43b0-9fbc-04140dbb6620\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") "
Jul 13 21:12:40.961180 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.961009    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-config\") pod \"8174428d-6c9a-43b0-9fbc-04140dbb6620\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") "
Jul 13 21:12:40.961180 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.961041    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-service-ca\") pod \"8174428d-6c9a-43b0-9fbc-04140dbb6620\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") "
Jul 13 21:12:40.961180 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.961070    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-trusted-ca-bundle\") pod \"8174428d-6c9a-43b0-9fbc-04140dbb6620\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") "
Jul 13 21:12:40.961180 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.961119    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-oauth-serving-cert\") pod \"8174428d-6c9a-43b0-9fbc-04140dbb6620\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") "
Jul 13 21:12:40.961370 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.961184    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-oauth-config\") pod \"8174428d-6c9a-43b0-9fbc-04140dbb6620\" (UID: \"8174428d-6c9a-43b0-9fbc-04140dbb6620\") "
Jul 13 21:12:40.961547 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.961518    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-config" (OuterVolumeSpecName: "console-config") pod "8174428d-6c9a-43b0-9fbc-04140dbb6620" (UID: "8174428d-6c9a-43b0-9fbc-04140dbb6620"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:12:40.961547 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.961531    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-service-ca" (OuterVolumeSpecName: "service-ca") pod "8174428d-6c9a-43b0-9fbc-04140dbb6620" (UID: "8174428d-6c9a-43b0-9fbc-04140dbb6620"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:12:40.961664 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.961594    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8174428d-6c9a-43b0-9fbc-04140dbb6620" (UID: "8174428d-6c9a-43b0-9fbc-04140dbb6620"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:12:40.961664 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.961617    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8174428d-6c9a-43b0-9fbc-04140dbb6620" (UID: "8174428d-6c9a-43b0-9fbc-04140dbb6620"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:12:40.963180 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.963155    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8174428d-6c9a-43b0-9fbc-04140dbb6620-kube-api-access-blfjw" (OuterVolumeSpecName: "kube-api-access-blfjw") pod "8174428d-6c9a-43b0-9fbc-04140dbb6620" (UID: "8174428d-6c9a-43b0-9fbc-04140dbb6620"). InnerVolumeSpecName "kube-api-access-blfjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:12:40.963291 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.963230    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8174428d-6c9a-43b0-9fbc-04140dbb6620" (UID: "8174428d-6c9a-43b0-9fbc-04140dbb6620"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:12:40.963291 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:40.963255    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8174428d-6c9a-43b0-9fbc-04140dbb6620" (UID: "8174428d-6c9a-43b0-9fbc-04140dbb6620"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:12:41.062278 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.062242    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-oauth-serving-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:12:41.062278 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.062271    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-oauth-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:12:41.062278 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.062282    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-serving-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:12:41.062526 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.062291    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blfjw\" (UniqueName: \"kubernetes.io/projected/8174428d-6c9a-43b0-9fbc-04140dbb6620-kube-api-access-blfjw\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:12:41.062526 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.062300    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-console-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:12:41.062526 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.062309    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:12:41.062526 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.062317    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8174428d-6c9a-43b0-9fbc-04140dbb6620-trusted-ca-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:12:41.601016 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.600983    2580 generic.go:356] "Generic (PLEG): container finished" podID="8174428d-6c9a-43b0-9fbc-04140dbb6620" containerID="f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807" exitCode=0
Jul 13 21:12:41.601440 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.601025    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69568597b8-pnlsn"
Jul 13 21:12:41.601440 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.601067    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69568597b8-pnlsn" event={"ID":"8174428d-6c9a-43b0-9fbc-04140dbb6620","Type":"ContainerDied","Data":"f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807"}
Jul 13 21:12:41.601440 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.601118    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69568597b8-pnlsn" event={"ID":"8174428d-6c9a-43b0-9fbc-04140dbb6620","Type":"ContainerDied","Data":"8148140735dbf6e835899602e59f81c97d55a416a8a972c1a1dcc7ec777fbfce"}
Jul 13 21:12:41.601440 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.601138    2580 scope.go:117] "RemoveContainer" containerID="f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807"
Jul 13 21:12:41.610355 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.610335    2580 scope.go:117] "RemoveContainer" containerID="f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807"
Jul 13 21:12:41.610626 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:12:41.610602    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807\": container with ID starting with f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807 not found: ID does not exist" containerID="f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807"
Jul 13 21:12:41.610718 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.610632    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807"} err="failed to get container status \"f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807\": rpc error: code = NotFound desc = could not find container \"f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807\": container with ID starting with f9e77013942f6e74e6617dde7866de26b73a7ddc1199792a39733993d1bc2807 not found: ID does not exist"
Jul 13 21:12:41.621514 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.621493    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69568597b8-pnlsn"]
Jul 13 21:12:41.624948 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:41.624920    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69568597b8-pnlsn"]
Jul 13 21:12:42.713377 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:12:42.713334    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8174428d-6c9a-43b0-9fbc-04140dbb6620" path="/var/lib/kubelet/pods/8174428d-6c9a-43b0-9fbc-04140dbb6620/volumes"
Jul 13 21:13:03.409000 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.408968    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"]
Jul 13 21:13:03.409376 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.409276    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8174428d-6c9a-43b0-9fbc-04140dbb6620" containerName="console"
Jul 13 21:13:03.409376 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.409286    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8174428d-6c9a-43b0-9fbc-04140dbb6620" containerName="console"
Jul 13 21:13:03.409376 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.409332    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8174428d-6c9a-43b0-9fbc-04140dbb6620" containerName="console"
Jul 13 21:13:03.413910 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.413892    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:03.415923 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.415899    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 13 21:13:03.416031 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.415962    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 13 21:13:03.416611 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.416594    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b57nk\""
Jul 13 21:13:03.419678 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.419654    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"]
Jul 13 21:13:03.549655 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.549624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdr55\" (UniqueName: \"kubernetes.io/projected/ae46f810-3cc4-484a-9f67-755af69b35bf-kube-api-access-zdr55\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8\" (UID: \"ae46f810-3cc4-484a-9f67-755af69b35bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:03.549797 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.549668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae46f810-3cc4-484a-9f67-755af69b35bf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8\" (UID: \"ae46f810-3cc4-484a-9f67-755af69b35bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:03.549797 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.549687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae46f810-3cc4-484a-9f67-755af69b35bf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8\" (UID: \"ae46f810-3cc4-484a-9f67-755af69b35bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:03.650932 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.650906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdr55\" (UniqueName: \"kubernetes.io/projected/ae46f810-3cc4-484a-9f67-755af69b35bf-kube-api-access-zdr55\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8\" (UID: \"ae46f810-3cc4-484a-9f67-755af69b35bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:03.651046 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.650945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae46f810-3cc4-484a-9f67-755af69b35bf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8\" (UID: \"ae46f810-3cc4-484a-9f67-755af69b35bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:03.651046 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.650964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae46f810-3cc4-484a-9f67-755af69b35bf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8\" (UID: \"ae46f810-3cc4-484a-9f67-755af69b35bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:03.651271 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.651252    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae46f810-3cc4-484a-9f67-755af69b35bf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8\" (UID: \"ae46f810-3cc4-484a-9f67-755af69b35bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:03.651309 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.651281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae46f810-3cc4-484a-9f67-755af69b35bf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8\" (UID: \"ae46f810-3cc4-484a-9f67-755af69b35bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:03.658662 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.658635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdr55\" (UniqueName: \"kubernetes.io/projected/ae46f810-3cc4-484a-9f67-755af69b35bf-kube-api-access-zdr55\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8\" (UID: \"ae46f810-3cc4-484a-9f67-755af69b35bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:03.724426 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.724363    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:03.851051 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:03.851029    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"]
Jul 13 21:13:04.691317 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:04.691272    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8" event={"ID":"ae46f810-3cc4-484a-9f67-755af69b35bf","Type":"ContainerStarted","Data":"75d10bbcbe05f42f087cee6321bb94d80ab39444ea1ffdb19a31b333ca5d8a10"}
Jul 13 21:13:12.726190 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:12.726157    2580 generic.go:356] "Generic (PLEG): container finished" podID="ae46f810-3cc4-484a-9f67-755af69b35bf" containerID="939b3d5b2654ac59ea92696fab490768883288237fc8026ee721599c1e744c88" exitCode=0
Jul 13 21:13:12.726599 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:12.726239    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8" event={"ID":"ae46f810-3cc4-484a-9f67-755af69b35bf","Type":"ContainerDied","Data":"939b3d5b2654ac59ea92696fab490768883288237fc8026ee721599c1e744c88"}
Jul 13 21:13:15.740772 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:15.740735    2580 generic.go:356] "Generic (PLEG): container finished" podID="ae46f810-3cc4-484a-9f67-755af69b35bf" containerID="553694c7af03402be2587a9accafe18a543b4fc6c1737585a39068bb4bc29b65" exitCode=0
Jul 13 21:13:15.741246 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:15.740796    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8" event={"ID":"ae46f810-3cc4-484a-9f67-755af69b35bf","Type":"ContainerDied","Data":"553694c7af03402be2587a9accafe18a543b4fc6c1737585a39068bb4bc29b65"}
Jul 13 21:13:25.786687 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:25.786651    2580 generic.go:356] "Generic (PLEG): container finished" podID="ae46f810-3cc4-484a-9f67-755af69b35bf" containerID="03e161f490c7a95588b861863e91f618fa6804f9d0b9cd0edd78e5a7393a37a3" exitCode=0
Jul 13 21:13:25.787071 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:25.786744    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8" event={"ID":"ae46f810-3cc4-484a-9f67-755af69b35bf","Type":"ContainerDied","Data":"03e161f490c7a95588b861863e91f618fa6804f9d0b9cd0edd78e5a7393a37a3"}
Jul 13 21:13:26.910535 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:26.910511    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:27.043949 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:27.043869    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae46f810-3cc4-484a-9f67-755af69b35bf-bundle\") pod \"ae46f810-3cc4-484a-9f67-755af69b35bf\" (UID: \"ae46f810-3cc4-484a-9f67-755af69b35bf\") "
Jul 13 21:13:27.043949 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:27.043909    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae46f810-3cc4-484a-9f67-755af69b35bf-util\") pod \"ae46f810-3cc4-484a-9f67-755af69b35bf\" (UID: \"ae46f810-3cc4-484a-9f67-755af69b35bf\") "
Jul 13 21:13:27.043949 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:27.043939    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdr55\" (UniqueName: \"kubernetes.io/projected/ae46f810-3cc4-484a-9f67-755af69b35bf-kube-api-access-zdr55\") pod \"ae46f810-3cc4-484a-9f67-755af69b35bf\" (UID: \"ae46f810-3cc4-484a-9f67-755af69b35bf\") "
Jul 13 21:13:27.044615 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:27.044588    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae46f810-3cc4-484a-9f67-755af69b35bf-bundle" (OuterVolumeSpecName: "bundle") pod "ae46f810-3cc4-484a-9f67-755af69b35bf" (UID: "ae46f810-3cc4-484a-9f67-755af69b35bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:13:27.046046 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:27.046015    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae46f810-3cc4-484a-9f67-755af69b35bf-kube-api-access-zdr55" (OuterVolumeSpecName: "kube-api-access-zdr55") pod "ae46f810-3cc4-484a-9f67-755af69b35bf" (UID: "ae46f810-3cc4-484a-9f67-755af69b35bf"). InnerVolumeSpecName "kube-api-access-zdr55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:13:27.050607 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:27.050582    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae46f810-3cc4-484a-9f67-755af69b35bf-util" (OuterVolumeSpecName: "util") pod "ae46f810-3cc4-484a-9f67-755af69b35bf" (UID: "ae46f810-3cc4-484a-9f67-755af69b35bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:13:27.145247 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:27.145203    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae46f810-3cc4-484a-9f67-755af69b35bf-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:13:27.145247 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:27.145239    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae46f810-3cc4-484a-9f67-755af69b35bf-util\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:13:27.145247 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:27.145249    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdr55\" (UniqueName: \"kubernetes.io/projected/ae46f810-3cc4-484a-9f67-755af69b35bf-kube-api-access-zdr55\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:13:27.796202 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:27.796164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8" event={"ID":"ae46f810-3cc4-484a-9f67-755af69b35bf","Type":"ContainerDied","Data":"75d10bbcbe05f42f087cee6321bb94d80ab39444ea1ffdb19a31b333ca5d8a10"}
Jul 13 21:13:27.796202 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:27.796199    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h5vx8"
Jul 13 21:13:27.796414 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:27.796220    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75d10bbcbe05f42f087cee6321bb94d80ab39444ea1ffdb19a31b333ca5d8a10"
Jul 13 21:13:31.361776 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.361741    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7"]
Jul 13 21:13:31.362192 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.362069    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae46f810-3cc4-484a-9f67-755af69b35bf" containerName="extract"
Jul 13 21:13:31.362192 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.362086    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae46f810-3cc4-484a-9f67-755af69b35bf" containerName="extract"
Jul 13 21:13:31.362192 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.362102    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae46f810-3cc4-484a-9f67-755af69b35bf" containerName="util"
Jul 13 21:13:31.362192 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.362111    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae46f810-3cc4-484a-9f67-755af69b35bf" containerName="util"
Jul 13 21:13:31.362192 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.362132    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae46f810-3cc4-484a-9f67-755af69b35bf" containerName="pull"
Jul 13 21:13:31.362192 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.362138    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae46f810-3cc4-484a-9f67-755af69b35bf" containerName="pull"
Jul 13 21:13:31.362449 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.362206    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae46f810-3cc4-484a-9f67-755af69b35bf" containerName="extract"
Jul 13 21:13:31.364616 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.364600    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7"
Jul 13 21:13:31.366838 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.366820    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 13 21:13:31.366942 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.366825    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:13:31.366942 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.366915    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nvcv9\""
Jul 13 21:13:31.376806 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.376787    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7"]
Jul 13 21:13:31.478554 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.478524    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-256js\" (UniqueName: \"kubernetes.io/projected/7eef2e90-ef03-457f-8628-babbe06cd24a-kube-api-access-256js\") pod \"cert-manager-operator-controller-manager-55c444bf86-94vb7\" (UID: \"7eef2e90-ef03-457f-8628-babbe06cd24a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7"
Jul 13 21:13:31.478732 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.478656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7eef2e90-ef03-457f-8628-babbe06cd24a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-94vb7\" (UID: \"7eef2e90-ef03-457f-8628-babbe06cd24a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7"
Jul 13 21:13:31.579671 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.579634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7eef2e90-ef03-457f-8628-babbe06cd24a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-94vb7\" (UID: \"7eef2e90-ef03-457f-8628-babbe06cd24a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7"
Jul 13 21:13:31.579854 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.579703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-256js\" (UniqueName: \"kubernetes.io/projected/7eef2e90-ef03-457f-8628-babbe06cd24a-kube-api-access-256js\") pod \"cert-manager-operator-controller-manager-55c444bf86-94vb7\" (UID: \"7eef2e90-ef03-457f-8628-babbe06cd24a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7"
Jul 13 21:13:31.580031 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.580011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7eef2e90-ef03-457f-8628-babbe06cd24a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-94vb7\" (UID: \"7eef2e90-ef03-457f-8628-babbe06cd24a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7"
Jul 13 21:13:31.587508 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.587479    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-256js\" (UniqueName: \"kubernetes.io/projected/7eef2e90-ef03-457f-8628-babbe06cd24a-kube-api-access-256js\") pod \"cert-manager-operator-controller-manager-55c444bf86-94vb7\" (UID: \"7eef2e90-ef03-457f-8628-babbe06cd24a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7"
Jul 13 21:13:31.674368 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.674334    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7"
Jul 13 21:13:31.810349 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:31.810326    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7"]
Jul 13 21:13:31.813250 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:13:31.813219    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eef2e90_ef03_457f_8628_babbe06cd24a.slice/crio-b7411b4e91bc8990a0fbe456a1793ce4c7e346fa237bcae54fc6fd0d9fa62287 WatchSource:0}: Error finding container b7411b4e91bc8990a0fbe456a1793ce4c7e346fa237bcae54fc6fd0d9fa62287: Status 404 returned error can't find the container with id b7411b4e91bc8990a0fbe456a1793ce4c7e346fa237bcae54fc6fd0d9fa62287
Jul 13 21:13:32.817447 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:32.817410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7" event={"ID":"7eef2e90-ef03-457f-8628-babbe06cd24a","Type":"ContainerStarted","Data":"b7411b4e91bc8990a0fbe456a1793ce4c7e346fa237bcae54fc6fd0d9fa62287"}
Jul 13 21:13:34.828315 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:34.828276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7" event={"ID":"7eef2e90-ef03-457f-8628-babbe06cd24a","Type":"ContainerStarted","Data":"8e9462cf79df24b7a28d21bb2146adb0cfd3301a6ee37f0c1fd9f7205ba22765"}
Jul 13 21:13:34.846568 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:34.846526    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-94vb7" podStartSLOduration=1.5450446599999998 podStartE2EDuration="3.846508924s" totalImagesPullingTime="2.301464264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:13:34.845799967 +0000 UTC m=+258.700944871" watchObservedRunningTime="2026-07-13 21:13:34.846508924 +0000 UTC m=+258.701653803"
Jul 13 21:13:35.619823 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.619789    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"]
Jul 13 21:13:35.622187 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.622164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:35.626724 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.626697    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b57nk\""
Jul 13 21:13:35.626866 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.626723    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 13 21:13:35.627508 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.627487    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 13 21:13:35.638662 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.638640    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"]
Jul 13 21:13:35.717664 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.717632    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl\" (UID: \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:35.717833 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.717687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6n5z\" (UniqueName: \"kubernetes.io/projected/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-kube-api-access-n6n5z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl\" (UID: \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:35.717833 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.717743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl\" (UID: \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:35.818282 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.818242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6n5z\" (UniqueName: \"kubernetes.io/projected/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-kube-api-access-n6n5z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl\" (UID: \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:35.818282 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.818282    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl\" (UID: \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:35.818507 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.818338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl\" (UID: \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:35.818689 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.818673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl\" (UID: \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:35.818724 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.818699    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl\" (UID: \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:35.830520 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.830491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6n5z\" (UniqueName: \"kubernetes.io/projected/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-kube-api-access-n6n5z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl\" (UID: \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:35.930907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:35.930875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:36.059842 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:36.059805    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"]
Jul 13 21:13:36.062280 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:13:36.062258    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6837d5ac_ad9e_42b6_bb2d_04153adb77ae.slice/crio-70c41c4791b9869ab6dacf1f648fa7513cf224ff9512226b58ab079d21a98bc2 WatchSource:0}: Error finding container 70c41c4791b9869ab6dacf1f648fa7513cf224ff9512226b58ab079d21a98bc2: Status 404 returned error can't find the container with id 70c41c4791b9869ab6dacf1f648fa7513cf224ff9512226b58ab079d21a98bc2
Jul 13 21:13:36.837759 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:36.837726    2580 generic.go:356] "Generic (PLEG): container finished" podID="6837d5ac-ad9e-42b6-bb2d-04153adb77ae" containerID="48935c30e0c13d73b0dce7b75003d95b2ae7256f1272519d17a1bf1f374e11df" exitCode=0
Jul 13 21:13:36.838077 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:36.837812    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl" event={"ID":"6837d5ac-ad9e-42b6-bb2d-04153adb77ae","Type":"ContainerDied","Data":"48935c30e0c13d73b0dce7b75003d95b2ae7256f1272519d17a1bf1f374e11df"}
Jul 13 21:13:36.838077 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:36.837875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl" event={"ID":"6837d5ac-ad9e-42b6-bb2d-04153adb77ae","Type":"ContainerStarted","Data":"70c41c4791b9869ab6dacf1f648fa7513cf224ff9512226b58ab079d21a98bc2"}
Jul 13 21:13:38.849478 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:38.849437    2580 generic.go:356] "Generic (PLEG): container finished" podID="6837d5ac-ad9e-42b6-bb2d-04153adb77ae" containerID="be2c74d39a588183d6a942379332b304cd62e77ddcde6952dea8b80e1bf8e16e" exitCode=0
Jul 13 21:13:38.849863 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:38.849511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl" event={"ID":"6837d5ac-ad9e-42b6-bb2d-04153adb77ae","Type":"ContainerDied","Data":"be2c74d39a588183d6a942379332b304cd62e77ddcde6952dea8b80e1bf8e16e"}
Jul 13 21:13:38.883700 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:38.883637    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-62wnn"]
Jul 13 21:13:38.886125 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:38.886110    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-62wnn"
Jul 13 21:13:38.888333 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:38.888314    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 13 21:13:38.888333 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:38.888327    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 13 21:13:38.888494 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:38.888327    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-8nzq4\""
Jul 13 21:13:38.898604 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:38.898578    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-62wnn"]
Jul 13 21:13:39.045538 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:39.045501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f015af94-1dab-4849-ba10-1b60f18d3ebb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-62wnn\" (UID: \"f015af94-1dab-4849-ba10-1b60f18d3ebb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-62wnn"
Jul 13 21:13:39.045678 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:39.045552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wvt8\" (UniqueName: \"kubernetes.io/projected/f015af94-1dab-4849-ba10-1b60f18d3ebb-kube-api-access-7wvt8\") pod \"cert-manager-cainjector-559cdd8c87-62wnn\" (UID: \"f015af94-1dab-4849-ba10-1b60f18d3ebb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-62wnn"
Jul 13 21:13:39.146455 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:39.146420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f015af94-1dab-4849-ba10-1b60f18d3ebb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-62wnn\" (UID: \"f015af94-1dab-4849-ba10-1b60f18d3ebb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-62wnn"
Jul 13 21:13:39.146601 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:39.146470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wvt8\" (UniqueName: \"kubernetes.io/projected/f015af94-1dab-4849-ba10-1b60f18d3ebb-kube-api-access-7wvt8\") pod \"cert-manager-cainjector-559cdd8c87-62wnn\" (UID: \"f015af94-1dab-4849-ba10-1b60f18d3ebb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-62wnn"
Jul 13 21:13:39.154522 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:39.154493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f015af94-1dab-4849-ba10-1b60f18d3ebb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-62wnn\" (UID: \"f015af94-1dab-4849-ba10-1b60f18d3ebb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-62wnn"
Jul 13 21:13:39.154714 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:39.154697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wvt8\" (UniqueName: \"kubernetes.io/projected/f015af94-1dab-4849-ba10-1b60f18d3ebb-kube-api-access-7wvt8\") pod \"cert-manager-cainjector-559cdd8c87-62wnn\" (UID: \"f015af94-1dab-4849-ba10-1b60f18d3ebb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-62wnn"
Jul 13 21:13:39.210100 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:39.210070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-62wnn"
Jul 13 21:13:39.331605 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:39.331579    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-62wnn"]
Jul 13 21:13:39.333267 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:13:39.333244    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf015af94_1dab_4849_ba10_1b60f18d3ebb.slice/crio-c7e718390d758a3fc7606daa8d3614baade20ab11b77890b8a0dfdf6143fda3e WatchSource:0}: Error finding container c7e718390d758a3fc7606daa8d3614baade20ab11b77890b8a0dfdf6143fda3e: Status 404 returned error can't find the container with id c7e718390d758a3fc7606daa8d3614baade20ab11b77890b8a0dfdf6143fda3e
Jul 13 21:13:39.856630 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:39.856596    2580 generic.go:356] "Generic (PLEG): container finished" podID="6837d5ac-ad9e-42b6-bb2d-04153adb77ae" containerID="ac2b064a8a34bc1e4627b938d1f48090b8eb5e19fdc09f403acb63576fbd9560" exitCode=0
Jul 13 21:13:39.857089 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:39.856675    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl" event={"ID":"6837d5ac-ad9e-42b6-bb2d-04153adb77ae","Type":"ContainerDied","Data":"ac2b064a8a34bc1e4627b938d1f48090b8eb5e19fdc09f403acb63576fbd9560"}
Jul 13 21:13:39.857956 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:39.857929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-62wnn" event={"ID":"f015af94-1dab-4849-ba10-1b60f18d3ebb","Type":"ContainerStarted","Data":"c7e718390d758a3fc7606daa8d3614baade20ab11b77890b8a0dfdf6143fda3e"}
Jul 13 21:13:41.007143 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.007115    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:41.062802 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.062767    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-util\") pod \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\" (UID: \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\") "
Jul 13 21:13:41.062973 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.062823    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6n5z\" (UniqueName: \"kubernetes.io/projected/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-kube-api-access-n6n5z\") pod \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\" (UID: \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\") "
Jul 13 21:13:41.062973 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.062859    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-bundle\") pod \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\" (UID: \"6837d5ac-ad9e-42b6-bb2d-04153adb77ae\") "
Jul 13 21:13:41.063343 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.063314    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-bundle" (OuterVolumeSpecName: "bundle") pod "6837d5ac-ad9e-42b6-bb2d-04153adb77ae" (UID: "6837d5ac-ad9e-42b6-bb2d-04153adb77ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:13:41.065084 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.065056    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-kube-api-access-n6n5z" (OuterVolumeSpecName: "kube-api-access-n6n5z") pod "6837d5ac-ad9e-42b6-bb2d-04153adb77ae" (UID: "6837d5ac-ad9e-42b6-bb2d-04153adb77ae"). InnerVolumeSpecName "kube-api-access-n6n5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:13:41.068964 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.068940    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-util" (OuterVolumeSpecName: "util") pod "6837d5ac-ad9e-42b6-bb2d-04153adb77ae" (UID: "6837d5ac-ad9e-42b6-bb2d-04153adb77ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:13:41.163734 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.163694    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-util\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:13:41.163734 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.163734    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6n5z\" (UniqueName: \"kubernetes.io/projected/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-kube-api-access-n6n5z\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:13:41.163930 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.163748    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6837d5ac-ad9e-42b6-bb2d-04153adb77ae-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:13:41.871271 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.871224    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl" event={"ID":"6837d5ac-ad9e-42b6-bb2d-04153adb77ae","Type":"ContainerDied","Data":"70c41c4791b9869ab6dacf1f648fa7513cf224ff9512226b58ab079d21a98bc2"}
Jul 13 21:13:41.871271 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.871278    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70c41c4791b9869ab6dacf1f648fa7513cf224ff9512226b58ab079d21a98bc2"
Jul 13 21:13:41.871539 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:41.871246    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsjhjl"
Jul 13 21:13:42.882135 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:42.882100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-62wnn" event={"ID":"f015af94-1dab-4849-ba10-1b60f18d3ebb","Type":"ContainerStarted","Data":"001793ec45c3f0e6096e4293e91b1cb3c6b66ef49bda0eb805f351d93aa257bb"}
Jul 13 21:13:42.897054 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:42.897001    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-62wnn" podStartSLOduration=2.239383358 podStartE2EDuration="4.896986465s" totalImagesPullingTime="2.657603107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:13:42.896739418 +0000 UTC m=+266.751884302" watchObservedRunningTime="2026-07-13 21:13:42.896986465 +0000 UTC m=+266.752131347"
Jul 13 21:13:43.491302 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.491248    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c5fpk"]
Jul 13 21:13:43.491633 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.491619    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6837d5ac-ad9e-42b6-bb2d-04153adb77ae" containerName="extract"
Jul 13 21:13:43.491684 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.491635    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6837d5ac-ad9e-42b6-bb2d-04153adb77ae" containerName="extract"
Jul 13 21:13:43.491684 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.491649    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6837d5ac-ad9e-42b6-bb2d-04153adb77ae" containerName="util"
Jul 13 21:13:43.491684 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.491655    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6837d5ac-ad9e-42b6-bb2d-04153adb77ae" containerName="util"
Jul 13 21:13:43.491684 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.491664    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6837d5ac-ad9e-42b6-bb2d-04153adb77ae" containerName="pull"
Jul 13 21:13:43.491684 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.491670    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6837d5ac-ad9e-42b6-bb2d-04153adb77ae" containerName="pull"
Jul 13 21:13:43.491817 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.491724    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6837d5ac-ad9e-42b6-bb2d-04153adb77ae" containerName="extract"
Jul 13 21:13:43.493767 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.493752    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk"
Jul 13 21:13:43.495717 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.495698    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dhsms\""
Jul 13 21:13:43.501357 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.501335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c5fpk"]
Jul 13 21:13:43.582650 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.582616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njs7t\" (UniqueName: \"kubernetes.io/projected/14527c50-853f-441f-b030-e8960c44925f-kube-api-access-njs7t\") pod \"cert-manager-webhook-6486ffd997-c5fpk\" (UID: \"14527c50-853f-441f-b030-e8960c44925f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk"
Jul 13 21:13:43.582650 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.582651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14527c50-853f-441f-b030-e8960c44925f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c5fpk\" (UID: \"14527c50-853f-441f-b030-e8960c44925f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk"
Jul 13 21:13:43.683065 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.683022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njs7t\" (UniqueName: \"kubernetes.io/projected/14527c50-853f-441f-b030-e8960c44925f-kube-api-access-njs7t\") pod \"cert-manager-webhook-6486ffd997-c5fpk\" (UID: \"14527c50-853f-441f-b030-e8960c44925f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk"
Jul 13 21:13:43.683065 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.683068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14527c50-853f-441f-b030-e8960c44925f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c5fpk\" (UID: \"14527c50-853f-441f-b030-e8960c44925f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk"
Jul 13 21:13:43.690816 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.690787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14527c50-853f-441f-b030-e8960c44925f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c5fpk\" (UID: \"14527c50-853f-441f-b030-e8960c44925f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk"
Jul 13 21:13:43.690946 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.690925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njs7t\" (UniqueName: \"kubernetes.io/projected/14527c50-853f-441f-b030-e8960c44925f-kube-api-access-njs7t\") pod \"cert-manager-webhook-6486ffd997-c5fpk\" (UID: \"14527c50-853f-441f-b030-e8960c44925f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk"
Jul 13 21:13:43.803558 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.803462    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk"
Jul 13 21:13:43.938872 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:43.938850    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c5fpk"]
Jul 13 21:13:43.941061 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:13:43.941029    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14527c50_853f_441f_b030_e8960c44925f.slice/crio-d9248257cec493e1c22d46978cfda259563770c39f9671d2a7050b5bc946d70f WatchSource:0}: Error finding container d9248257cec493e1c22d46978cfda259563770c39f9671d2a7050b5bc946d70f: Status 404 returned error can't find the container with id d9248257cec493e1c22d46978cfda259563770c39f9671d2a7050b5bc946d70f
Jul 13 21:13:44.893193 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:44.893162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk" event={"ID":"14527c50-853f-441f-b030-e8960c44925f","Type":"ContainerStarted","Data":"0f84720d961db689629cd2163b0e3524c163858e2fe131f1f99b894b6170e372"}
Jul 13 21:13:44.893193 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:44.893200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk" event={"ID":"14527c50-853f-441f-b030-e8960c44925f","Type":"ContainerStarted","Data":"d9248257cec493e1c22d46978cfda259563770c39f9671d2a7050b5bc946d70f"}
Jul 13 21:13:44.893500 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:44.893228    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk"
Jul 13 21:13:44.910003 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:44.909959    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk" podStartSLOduration=1.909944038 podStartE2EDuration="1.909944038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:13:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:13:44.908227021 +0000 UTC m=+268.763371904" watchObservedRunningTime="2026-07-13 21:13:44.909944038 +0000 UTC m=+268.765088919"
Jul 13 21:13:45.617395 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:45.617343    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fgl76"]
Jul 13 21:13:45.619673 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:45.619655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fgl76"
Jul 13 21:13:45.621829 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:45.621811    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pc9dr\""
Jul 13 21:13:45.629128 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:45.629102    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fgl76"]
Jul 13 21:13:45.697006 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:45.696972    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwfpx\" (UniqueName: \"kubernetes.io/projected/e15fb5a3-df6b-4a42-acf6-f87539e8356d-kube-api-access-rwfpx\") pod \"cert-manager-55b4d954d5-fgl76\" (UID: \"e15fb5a3-df6b-4a42-acf6-f87539e8356d\") " pod="cert-manager/cert-manager-55b4d954d5-fgl76"
Jul 13 21:13:45.697140 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:45.697031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e15fb5a3-df6b-4a42-acf6-f87539e8356d-bound-sa-token\") pod \"cert-manager-55b4d954d5-fgl76\" (UID: \"e15fb5a3-df6b-4a42-acf6-f87539e8356d\") " pod="cert-manager/cert-manager-55b4d954d5-fgl76"
Jul 13 21:13:45.797745 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:45.797713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e15fb5a3-df6b-4a42-acf6-f87539e8356d-bound-sa-token\") pod \"cert-manager-55b4d954d5-fgl76\" (UID: \"e15fb5a3-df6b-4a42-acf6-f87539e8356d\") " pod="cert-manager/cert-manager-55b4d954d5-fgl76"
Jul 13 21:13:45.797878 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:45.797817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwfpx\" (UniqueName: \"kubernetes.io/projected/e15fb5a3-df6b-4a42-acf6-f87539e8356d-kube-api-access-rwfpx\") pod \"cert-manager-55b4d954d5-fgl76\" (UID: \"e15fb5a3-df6b-4a42-acf6-f87539e8356d\") " pod="cert-manager/cert-manager-55b4d954d5-fgl76"
Jul 13 21:13:45.805913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:45.805884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e15fb5a3-df6b-4a42-acf6-f87539e8356d-bound-sa-token\") pod \"cert-manager-55b4d954d5-fgl76\" (UID: \"e15fb5a3-df6b-4a42-acf6-f87539e8356d\") " pod="cert-manager/cert-manager-55b4d954d5-fgl76"
Jul 13 21:13:45.806058 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:45.806030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwfpx\" (UniqueName: \"kubernetes.io/projected/e15fb5a3-df6b-4a42-acf6-f87539e8356d-kube-api-access-rwfpx\") pod \"cert-manager-55b4d954d5-fgl76\" (UID: \"e15fb5a3-df6b-4a42-acf6-f87539e8356d\") " pod="cert-manager/cert-manager-55b4d954d5-fgl76"
Jul 13 21:13:45.930116 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:45.930086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fgl76"
Jul 13 21:13:46.053038 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:46.053015    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fgl76"]
Jul 13 21:13:46.055596 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:13:46.055569    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode15fb5a3_df6b_4a42_acf6_f87539e8356d.slice/crio-ae244fc72ddd441853cb8755d06f9883e03ddf6c31902d4633235575aedf8e38 WatchSource:0}: Error finding container ae244fc72ddd441853cb8755d06f9883e03ddf6c31902d4633235575aedf8e38: Status 404 returned error can't find the container with id ae244fc72ddd441853cb8755d06f9883e03ddf6c31902d4633235575aedf8e38
Jul 13 21:13:46.903683 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:46.903649    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fgl76" event={"ID":"e15fb5a3-df6b-4a42-acf6-f87539e8356d","Type":"ContainerStarted","Data":"718f48aacf15b497703ee552c73b422ee54f1616cb52ac498442147b4e777d96"}
Jul 13 21:13:46.903683 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:46.903690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fgl76" event={"ID":"e15fb5a3-df6b-4a42-acf6-f87539e8356d","Type":"ContainerStarted","Data":"ae244fc72ddd441853cb8755d06f9883e03ddf6c31902d4633235575aedf8e38"}
Jul 13 21:13:46.918731 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:46.918678    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-fgl76" podStartSLOduration=1.918662552 podStartE2EDuration="1.918662552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:13:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:13:46.917292277 +0000 UTC m=+270.772437162" watchObservedRunningTime="2026-07-13 21:13:46.918662552 +0000 UTC m=+270.773807435"
Jul 13 21:13:50.900042 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:50.900013    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c5fpk"
Jul 13 21:13:56.108828 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.108755    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"]
Jul 13 21:13:56.114579 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.114555    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:13:56.116912 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.116892    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 13 21:13:56.117087 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.117071    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b57nk\""
Jul 13 21:13:56.117140 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.117115    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 13 21:13:56.124526 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.124507    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"]
Jul 13 21:13:56.178928 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.178901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x\" (UID: \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:13:56.179049 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.178939    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8wqg\" (UniqueName: \"kubernetes.io/projected/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-kube-api-access-w8wqg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x\" (UID: \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:13:56.179049 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.178992    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x\" (UID: \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:13:56.279686 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.279652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x\" (UID: \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:13:56.279826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.279710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8wqg\" (UniqueName: \"kubernetes.io/projected/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-kube-api-access-w8wqg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x\" (UID: \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:13:56.279826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.279752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x\" (UID: \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:13:56.280063 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.280044    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x\" (UID: \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:13:56.280103 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.280071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x\" (UID: \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:13:56.287108 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.287082    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8wqg\" (UniqueName: \"kubernetes.io/projected/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-kube-api-access-w8wqg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x\" (UID: \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:13:56.424311 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.424285    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:13:56.554016 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.553982    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"]
Jul 13 21:13:56.557245 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:13:56.557217    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb9be152_ed51_4fcb_b8c6_fdd4d9252bce.slice/crio-2c39e8e14babd05d10904943a8b4b89483d8b9622feff2be165f82993da79229 WatchSource:0}: Error finding container 2c39e8e14babd05d10904943a8b4b89483d8b9622feff2be165f82993da79229: Status 404 returned error can't find the container with id 2c39e8e14babd05d10904943a8b4b89483d8b9622feff2be165f82993da79229
Jul 13 21:13:56.946786 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.946752    2580 generic.go:356] "Generic (PLEG): container finished" podID="cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" containerID="aac1dd56d0bd5d785606d03b82a72f07b9ed4b347301f595ce0fd3e4c52842e9" exitCode=0
Jul 13 21:13:56.946956 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.946819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x" event={"ID":"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce","Type":"ContainerDied","Data":"aac1dd56d0bd5d785606d03b82a72f07b9ed4b347301f595ce0fd3e4c52842e9"}
Jul 13 21:13:56.946956 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:56.946856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x" event={"ID":"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce","Type":"ContainerStarted","Data":"2c39e8e14babd05d10904943a8b4b89483d8b9622feff2be165f82993da79229"}
Jul 13 21:13:58.958495 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:58.958453    2580 generic.go:356] "Generic (PLEG): container finished" podID="cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" containerID="5f2498df26bfb944c4ba10f22a56fef31a1cc4648af1c26a8e3d8b25c4c8aaca" exitCode=0
Jul 13 21:13:58.958851 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:58.958539    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x" event={"ID":"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce","Type":"ContainerDied","Data":"5f2498df26bfb944c4ba10f22a56fef31a1cc4648af1c26a8e3d8b25c4c8aaca"}
Jul 13 21:13:59.964538 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:59.964503    2580 generic.go:356] "Generic (PLEG): container finished" podID="cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" containerID="4ad1179d2a4d46a956eb7cd965beef061873e7cb8d34124ba8c14d857018fcde" exitCode=0
Jul 13 21:13:59.964915 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:13:59.964563    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x" event={"ID":"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce","Type":"ContainerDied","Data":"4ad1179d2a4d46a956eb7cd965beef061873e7cb8d34124ba8c14d857018fcde"}
Jul 13 21:14:01.095926 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.095903    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:14:01.118880 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.118855    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-util\") pod \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\" (UID: \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\") "
Jul 13 21:14:01.119005 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.118974    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8wqg\" (UniqueName: \"kubernetes.io/projected/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-kube-api-access-w8wqg\") pod \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\" (UID: \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\") "
Jul 13 21:14:01.119061 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.119032    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-bundle\") pod \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\" (UID: \"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce\") "
Jul 13 21:14:01.119944 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.119911    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-bundle" (OuterVolumeSpecName: "bundle") pod "cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" (UID: "cb9be152-ed51-4fcb-b8c6-fdd4d9252bce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:14:01.120989 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.120965    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-kube-api-access-w8wqg" (OuterVolumeSpecName: "kube-api-access-w8wqg") pod "cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" (UID: "cb9be152-ed51-4fcb-b8c6-fdd4d9252bce"). InnerVolumeSpecName "kube-api-access-w8wqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:14:01.127281 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.127240    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-util" (OuterVolumeSpecName: "util") pod "cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" (UID: "cb9be152-ed51-4fcb-b8c6-fdd4d9252bce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:14:01.220419 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.220340    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:14:01.220419 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.220360    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-util\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:14:01.220419 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.220369    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8wqg\" (UniqueName: \"kubernetes.io/projected/cb9be152-ed51-4fcb-b8c6-fdd4d9252bce-kube-api-access-w8wqg\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:14:01.975437 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.975399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x" event={"ID":"cb9be152-ed51-4fcb-b8c6-fdd4d9252bce","Type":"ContainerDied","Data":"2c39e8e14babd05d10904943a8b4b89483d8b9622feff2be165f82993da79229"}
Jul 13 21:14:01.975599 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.975473    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c39e8e14babd05d10904943a8b4b89483d8b9622feff2be165f82993da79229"
Jul 13 21:14:01.975599 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:01.975408    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd825x"
Jul 13 21:14:07.974259 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.974224    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"]
Jul 13 21:14:07.974669 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.974568    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" containerName="pull"
Jul 13 21:14:07.974669 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.974580    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" containerName="pull"
Jul 13 21:14:07.974669 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.974591    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" containerName="extract"
Jul 13 21:14:07.974669 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.974597    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" containerName="extract"
Jul 13 21:14:07.974669 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.974608    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" containerName="util"
Jul 13 21:14:07.974669 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.974613    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" containerName="util"
Jul 13 21:14:07.974669 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.974663    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb9be152-ed51-4fcb-b8c6-fdd4d9252bce" containerName="extract"
Jul 13 21:14:07.977264 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.977248    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:07.979690 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.979657    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 21:14:07.979690 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.979685    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 21:14:07.979931 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.979768    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8vjt2\""
Jul 13 21:14:07.979931 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.979799    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 21:14:07.979931 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.979803    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 21:14:07.993177 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:07.993152    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"]
Jul 13 21:14:08.074586 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.074551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6cd4cba3-f405-4b3a-9364-349061346f19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.074757 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.074615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cd4cba3-f405-4b3a-9364-349061346f19-tmp\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.074757 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.074645    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6cd4cba3-f405-4b3a-9364-349061346f19-manifests\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.074757 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.074668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7zkw\" (UniqueName: \"kubernetes.io/projected/6cd4cba3-f405-4b3a-9364-349061346f19-kube-api-access-v7zkw\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.074757 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.074697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cd4cba3-f405-4b3a-9364-349061346f19-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.175972 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.175939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6cd4cba3-f405-4b3a-9364-349061346f19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.176146 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.175981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cd4cba3-f405-4b3a-9364-349061346f19-tmp\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.176146 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.176000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6cd4cba3-f405-4b3a-9364-349061346f19-manifests\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.176146 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.176018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7zkw\" (UniqueName: \"kubernetes.io/projected/6cd4cba3-f405-4b3a-9364-349061346f19-kube-api-access-v7zkw\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.176146 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.176035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cd4cba3-f405-4b3a-9364-349061346f19-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.176453 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.176427    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6cd4cba3-f405-4b3a-9364-349061346f19-manifests\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.178473 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.178453    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cd4cba3-f405-4b3a-9364-349061346f19-tmp\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.178574 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.178554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6cd4cba3-f405-4b3a-9364-349061346f19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.178632 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.178573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cd4cba3-f405-4b3a-9364-349061346f19-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.183919 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.183896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7zkw\" (UniqueName: \"kubernetes.io/projected/6cd4cba3-f405-4b3a-9364-349061346f19-kube-api-access-v7zkw\") pod \"opendatahub-operator-controller-manager-84fb46456c-srrq6\" (UID: \"6cd4cba3-f405-4b3a-9364-349061346f19\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.287783 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.287714    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:08.440013 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:08.439990    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"]
Jul 13 21:14:08.442090 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:14:08.442062    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd4cba3_f405_4b3a_9364_349061346f19.slice/crio-6d7e6bd421afcda4f9c1abdbfc5552cc7a4196032c7169c28ee869b5f7aa661d WatchSource:0}: Error finding container 6d7e6bd421afcda4f9c1abdbfc5552cc7a4196032c7169c28ee869b5f7aa661d: Status 404 returned error can't find the container with id 6d7e6bd421afcda4f9c1abdbfc5552cc7a4196032c7169c28ee869b5f7aa661d
Jul 13 21:14:09.014180 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:09.014147    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6" event={"ID":"6cd4cba3-f405-4b3a-9364-349061346f19","Type":"ContainerStarted","Data":"6d7e6bd421afcda4f9c1abdbfc5552cc7a4196032c7169c28ee869b5f7aa661d"}
Jul 13 21:14:12.032687 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:12.032645    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6" event={"ID":"6cd4cba3-f405-4b3a-9364-349061346f19","Type":"ContainerStarted","Data":"eecd7ab1404825aa2919ae324e03c66494b2b8f0d1cfdd6cfb6d4835d895f463"}
Jul 13 21:14:13.039757 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:13.039660    2580 generic.go:356] "Generic (PLEG): container finished" podID="6cd4cba3-f405-4b3a-9364-349061346f19" containerID="eecd7ab1404825aa2919ae324e03c66494b2b8f0d1cfdd6cfb6d4835d895f463" exitCode=0
Jul 13 21:14:13.040242 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:13.039762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6" event={"ID":"6cd4cba3-f405-4b3a-9364-349061346f19","Type":"ContainerDied","Data":"eecd7ab1404825aa2919ae324e03c66494b2b8f0d1cfdd6cfb6d4835d895f463"}
Jul 13 21:14:14.046076 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:14.046033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6" event={"ID":"6cd4cba3-f405-4b3a-9364-349061346f19","Type":"ContainerStarted","Data":"ef4c5a543ee4cd1d0b815262c82f0c49460a78550912f2e8a7b7f8395951ee29"}
Jul 13 21:14:14.046465 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:14.046111    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:14.067342 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:14.067296    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6" podStartSLOduration=2.520024248 podStartE2EDuration="7.067283568s" totalImagesPullingTime="3.503627858s" totalInitContainerRuntime="1.043631462s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:14:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:14:14.066235595 +0000 UTC m=+297.921380479" watchObservedRunningTime="2026-07-13 21:14:14.067283568 +0000 UTC m=+297.922428448"
Jul 13 21:14:16.627712 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:16.627682    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:14:16.628187 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:16.628167    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:14:16.633268 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:16.633250    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 21:14:25.052797 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:25.052761    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-srrq6"
Jul 13 21:14:27.651822 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.651789    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"]
Jul 13 21:14:27.655213 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.655192    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"
Jul 13 21:14:27.657912 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.657885    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 21:14:27.658128 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.658112    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 21:14:27.683073 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.683042    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"]
Jul 13 21:14:27.755016 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.754978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad8d512-d710-4129-b320-e9f95909b9af-tmp\") pod \"kube-auth-proxy-575f48bc89-nxr4c\" (UID: \"aad8d512-d710-4129-b320-e9f95909b9af\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"
Jul 13 21:14:27.755016 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.755026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad8d512-d710-4129-b320-e9f95909b9af-tls-certs\") pod \"kube-auth-proxy-575f48bc89-nxr4c\" (UID: \"aad8d512-d710-4129-b320-e9f95909b9af\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"
Jul 13 21:14:27.755243 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.755109    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scqtm\" (UniqueName: \"kubernetes.io/projected/aad8d512-d710-4129-b320-e9f95909b9af-kube-api-access-scqtm\") pod \"kube-auth-proxy-575f48bc89-nxr4c\" (UID: \"aad8d512-d710-4129-b320-e9f95909b9af\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"
Jul 13 21:14:27.856521 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.856486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad8d512-d710-4129-b320-e9f95909b9af-tmp\") pod \"kube-auth-proxy-575f48bc89-nxr4c\" (UID: \"aad8d512-d710-4129-b320-e9f95909b9af\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"
Jul 13 21:14:27.856697 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.856538    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad8d512-d710-4129-b320-e9f95909b9af-tls-certs\") pod \"kube-auth-proxy-575f48bc89-nxr4c\" (UID: \"aad8d512-d710-4129-b320-e9f95909b9af\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"
Jul 13 21:14:27.856697 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.856584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scqtm\" (UniqueName: \"kubernetes.io/projected/aad8d512-d710-4129-b320-e9f95909b9af-kube-api-access-scqtm\") pod \"kube-auth-proxy-575f48bc89-nxr4c\" (UID: \"aad8d512-d710-4129-b320-e9f95909b9af\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"
Jul 13 21:14:27.856783 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:14:27.856739    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 13 21:14:27.856830 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:14:27.856817    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad8d512-d710-4129-b320-e9f95909b9af-tls-certs podName:aad8d512-d710-4129-b320-e9f95909b9af nodeName:}" failed. No retries permitted until 2026-07-13 21:14:28.356798463 +0000 UTC m=+312.211943327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/aad8d512-d710-4129-b320-e9f95909b9af-tls-certs") pod "kube-auth-proxy-575f48bc89-nxr4c" (UID: "aad8d512-d710-4129-b320-e9f95909b9af") : secret "kube-auth-proxy-tls" not found
Jul 13 21:14:27.858908 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.858878    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad8d512-d710-4129-b320-e9f95909b9af-tmp\") pod \"kube-auth-proxy-575f48bc89-nxr4c\" (UID: \"aad8d512-d710-4129-b320-e9f95909b9af\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"
Jul 13 21:14:27.867769 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.867744    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scqtm\" (UniqueName: \"kubernetes.io/projected/aad8d512-d710-4129-b320-e9f95909b9af-kube-api-access-scqtm\") pod \"kube-auth-proxy-575f48bc89-nxr4c\" (UID: \"aad8d512-d710-4129-b320-e9f95909b9af\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"
Jul 13 21:14:27.959054 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.958953    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8gm2n"]
Jul 13 21:14:27.965393 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.965359    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n"
Jul 13 21:14:27.967661 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.967632    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 13 21:14:27.967984 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.967963    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fdgvl\""
Jul 13 21:14:27.970923 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:27.970900    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8gm2n"]
Jul 13 21:14:28.062589 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.062551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn74l\" (UniqueName: \"kubernetes.io/projected/2ce4d85b-8865-4ba9-bbc5-6d73b73485cd-kube-api-access-bn74l\") pod \"odh-model-controller-7998c67dc4-8gm2n\" (UID: \"2ce4d85b-8865-4ba9-bbc5-6d73b73485cd\") " pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n"
Jul 13 21:14:28.062589 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.062590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ce4d85b-8865-4ba9-bbc5-6d73b73485cd-cert\") pod \"odh-model-controller-7998c67dc4-8gm2n\" (UID: \"2ce4d85b-8865-4ba9-bbc5-6d73b73485cd\") " pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n"
Jul 13 21:14:28.163709 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.163676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn74l\" (UniqueName: \"kubernetes.io/projected/2ce4d85b-8865-4ba9-bbc5-6d73b73485cd-kube-api-access-bn74l\") pod \"odh-model-controller-7998c67dc4-8gm2n\" (UID: \"2ce4d85b-8865-4ba9-bbc5-6d73b73485cd\") " pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n"
Jul 13 21:14:28.163709 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.163719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ce4d85b-8865-4ba9-bbc5-6d73b73485cd-cert\") pod \"odh-model-controller-7998c67dc4-8gm2n\" (UID: \"2ce4d85b-8865-4ba9-bbc5-6d73b73485cd\") " pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n"
Jul 13 21:14:28.166245 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.166221    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ce4d85b-8865-4ba9-bbc5-6d73b73485cd-cert\") pod \"odh-model-controller-7998c67dc4-8gm2n\" (UID: \"2ce4d85b-8865-4ba9-bbc5-6d73b73485cd\") " pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n"
Jul 13 21:14:28.173267 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.173247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn74l\" (UniqueName: \"kubernetes.io/projected/2ce4d85b-8865-4ba9-bbc5-6d73b73485cd-kube-api-access-bn74l\") pod \"odh-model-controller-7998c67dc4-8gm2n\" (UID: \"2ce4d85b-8865-4ba9-bbc5-6d73b73485cd\") " pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n"
Jul 13 21:14:28.277172 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.277077    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n"
Jul 13 21:14:28.365615 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.365584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad8d512-d710-4129-b320-e9f95909b9af-tls-certs\") pod \"kube-auth-proxy-575f48bc89-nxr4c\" (UID: \"aad8d512-d710-4129-b320-e9f95909b9af\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"
Jul 13 21:14:28.368118 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.368091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad8d512-d710-4129-b320-e9f95909b9af-tls-certs\") pod \"kube-auth-proxy-575f48bc89-nxr4c\" (UID: \"aad8d512-d710-4129-b320-e9f95909b9af\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"
Jul 13 21:14:28.418758 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.418717    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8gm2n"]
Jul 13 21:14:28.422955 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:14:28.422929    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce4d85b_8865_4ba9_bbc5_6d73b73485cd.slice/crio-2f53e9c9d5428a16ec1559ff2e0be051f683580d10a94a213611897cf0852176 WatchSource:0}: Error finding container 2f53e9c9d5428a16ec1559ff2e0be051f683580d10a94a213611897cf0852176: Status 404 returned error can't find the container with id 2f53e9c9d5428a16ec1559ff2e0be051f683580d10a94a213611897cf0852176
Jul 13 21:14:28.424660 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.424642    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:14:28.565574 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.565493    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"
Jul 13 21:14:28.715469 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.715414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c"]
Jul 13 21:14:28.718918 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:14:28.718893    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad8d512_d710_4129_b320_e9f95909b9af.slice/crio-6df515a2ae36815a157a3960166fec64741eb79dc90b897ee4dfbcc83388a08a WatchSource:0}: Error finding container 6df515a2ae36815a157a3960166fec64741eb79dc90b897ee4dfbcc83388a08a: Status 404 returned error can't find the container with id 6df515a2ae36815a157a3960166fec64741eb79dc90b897ee4dfbcc83388a08a
Jul 13 21:14:28.954641 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.954607    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zm5t9"]
Jul 13 21:14:28.959160 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.959137    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9"
Jul 13 21:14:28.962719 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.962687    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 13 21:14:28.962988 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.962972    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jnbfk\""
Jul 13 21:14:28.968308 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:28.968288    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zm5t9"]
Jul 13 21:14:29.071839 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.071804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzqzp\" (UniqueName: \"kubernetes.io/projected/9c98b41c-9d63-4b8b-882e-01ba7ad49241-kube-api-access-zzqzp\") pod \"model-serving-api-54d89bd5fc-zm5t9\" (UID: \"9c98b41c-9d63-4b8b-882e-01ba7ad49241\") " pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9"
Jul 13 21:14:29.071993 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.071898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c98b41c-9d63-4b8b-882e-01ba7ad49241-tls-certs\") pod \"model-serving-api-54d89bd5fc-zm5t9\" (UID: \"9c98b41c-9d63-4b8b-882e-01ba7ad49241\") " pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9"
Jul 13 21:14:29.108728 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.108686    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"]
Jul 13 21:14:29.112129 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.112110    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.114154 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.114132    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 13 21:14:29.114264 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.114179    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 13 21:14:29.114264 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.114253    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 13 21:14:29.114670 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.114647    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dvlnl\""
Jul 13 21:14:29.114670 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.114662    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 21:14:29.116789 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.116767    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n" event={"ID":"2ce4d85b-8865-4ba9-bbc5-6d73b73485cd","Type":"ContainerStarted","Data":"2f53e9c9d5428a16ec1559ff2e0be051f683580d10a94a213611897cf0852176"}
Jul 13 21:14:29.118027 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.118007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c" event={"ID":"aad8d512-d710-4129-b320-e9f95909b9af","Type":"ContainerStarted","Data":"6df515a2ae36815a157a3960166fec64741eb79dc90b897ee4dfbcc83388a08a"}
Jul 13 21:14:29.125270 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.125245    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"]
Jul 13 21:14:29.173058 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.173026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c98b41c-9d63-4b8b-882e-01ba7ad49241-tls-certs\") pod \"model-serving-api-54d89bd5fc-zm5t9\" (UID: \"9c98b41c-9d63-4b8b-882e-01ba7ad49241\") " pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9"
Jul 13 21:14:29.173214 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.173085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzqzp\" (UniqueName: \"kubernetes.io/projected/9c98b41c-9d63-4b8b-882e-01ba7ad49241-kube-api-access-zzqzp\") pod \"model-serving-api-54d89bd5fc-zm5t9\" (UID: \"9c98b41c-9d63-4b8b-882e-01ba7ad49241\") " pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9"
Jul 13 21:14:29.173214 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:14:29.173185    2580 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 13 21:14:29.173298 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:14:29.173248    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c98b41c-9d63-4b8b-882e-01ba7ad49241-tls-certs podName:9c98b41c-9d63-4b8b-882e-01ba7ad49241 nodeName:}" failed. No retries permitted until 2026-07-13 21:14:29.673231006 +0000 UTC m=+313.528375866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9c98b41c-9d63-4b8b-882e-01ba7ad49241-tls-certs") pod "model-serving-api-54d89bd5fc-zm5t9" (UID: "9c98b41c-9d63-4b8b-882e-01ba7ad49241") : secret "model-serving-api-tls" not found
Jul 13 21:14:29.185950 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.185925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzqzp\" (UniqueName: \"kubernetes.io/projected/9c98b41c-9d63-4b8b-882e-01ba7ad49241-kube-api-access-zzqzp\") pod \"model-serving-api-54d89bd5fc-zm5t9\" (UID: \"9c98b41c-9d63-4b8b-882e-01ba7ad49241\") " pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9"
Jul 13 21:14:29.274239 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.274157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-cacerts\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.274239 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.274203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.274465 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.274277    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30ec4aa-2b80-42d6-b046-f6ed4a297400-local-certs\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.274465 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.274318    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.274465 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.274348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-token\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.274465 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.274406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.274465 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.274452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pzg4\" (UniqueName: \"kubernetes.io/projected/f30ec4aa-2b80-42d6-b046-f6ed4a297400-kube-api-access-8pzg4\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.376086 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.375984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30ec4aa-2b80-42d6-b046-f6ed4a297400-local-certs\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.376272 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.376175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.376337 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.376255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-token\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.376416 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.376358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.376820 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.376456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pzg4\" (UniqueName: \"kubernetes.io/projected/f30ec4aa-2b80-42d6-b046-f6ed4a297400-kube-api-access-8pzg4\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.376820 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.376540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-cacerts\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.376820 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.376606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.377047 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.377021    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.379628 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.379583    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-cacerts\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.380003 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.379963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30ec4aa-2b80-42d6-b046-f6ed4a297400-local-certs\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.380352 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.380296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.380482 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.380357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.386225 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.386198    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pzg4\" (UniqueName: \"kubernetes.io/projected/f30ec4aa-2b80-42d6-b046-f6ed4a297400-kube-api-access-8pzg4\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.387201 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.387178    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-token\") pod \"istiod-openshift-gateway-7574459656-4bkkx\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.422498 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.422316    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:29.592870 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.592806    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"]
Jul 13 21:14:29.597095 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:14:29.597061    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30ec4aa_2b80_42d6_b046_f6ed4a297400.slice/crio-06e783c3a1a0a44db16b58ccb72c30b30c3c7a570323e4fbecbf2a68430f06c6 WatchSource:0}: Error finding container 06e783c3a1a0a44db16b58ccb72c30b30c3c7a570323e4fbecbf2a68430f06c6: Status 404 returned error can't find the container with id 06e783c3a1a0a44db16b58ccb72c30b30c3c7a570323e4fbecbf2a68430f06c6
Jul 13 21:14:29.680575 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.680534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c98b41c-9d63-4b8b-882e-01ba7ad49241-tls-certs\") pod \"model-serving-api-54d89bd5fc-zm5t9\" (UID: \"9c98b41c-9d63-4b8b-882e-01ba7ad49241\") " pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9"
Jul 13 21:14:29.683633 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.683602    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c98b41c-9d63-4b8b-882e-01ba7ad49241-tls-certs\") pod \"model-serving-api-54d89bd5fc-zm5t9\" (UID: \"9c98b41c-9d63-4b8b-882e-01ba7ad49241\") " pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9"
Jul 13 21:14:29.870773 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:29.870689    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9"
Jul 13 21:14:30.057114 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:30.057082    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zm5t9"]
Jul 13 21:14:30.059548 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:14:30.059517    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c98b41c_9d63_4b8b_882e_01ba7ad49241.slice/crio-1f7b618bd72df0c7672675da3def940375df43638e536f078ebabb1f4075e7d3 WatchSource:0}: Error finding container 1f7b618bd72df0c7672675da3def940375df43638e536f078ebabb1f4075e7d3: Status 404 returned error can't find the container with id 1f7b618bd72df0c7672675da3def940375df43638e536f078ebabb1f4075e7d3
Jul 13 21:14:30.126818 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:30.126716    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9" event={"ID":"9c98b41c-9d63-4b8b-882e-01ba7ad49241","Type":"ContainerStarted","Data":"1f7b618bd72df0c7672675da3def940375df43638e536f078ebabb1f4075e7d3"}
Jul 13 21:14:30.128291 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:30.128253    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx" event={"ID":"f30ec4aa-2b80-42d6-b046-f6ed4a297400","Type":"ContainerStarted","Data":"06e783c3a1a0a44db16b58ccb72c30b30c3c7a570323e4fbecbf2a68430f06c6"}
Jul 13 21:14:33.146593 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:33.146550    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c" event={"ID":"aad8d512-d710-4129-b320-e9f95909b9af","Type":"ContainerStarted","Data":"a5f23fac61cc2daf62077821971808958613c6a0f39c728e1d7377198b5ea882"}
Jul 13 21:14:33.148133 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:33.148097    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9" event={"ID":"9c98b41c-9d63-4b8b-882e-01ba7ad49241","Type":"ContainerStarted","Data":"86596c3ef10a5be75aed74222a93a6f34a5edaf3de97b6754119c6a5e3db12f9"}
Jul 13 21:14:33.148271 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:33.148160    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9"
Jul 13 21:14:33.149563 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:33.149541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n" event={"ID":"2ce4d85b-8865-4ba9-bbc5-6d73b73485cd","Type":"ContainerStarted","Data":"fd54e082964fb83499d5a45d9c7b9501e6aefb1f08f7b1b707ed60da5db3c242"}
Jul 13 21:14:33.149682 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:33.149669    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n"
Jul 13 21:14:33.163664 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:33.163623    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-575f48bc89-nxr4c" podStartSLOduration=2.158066323 podStartE2EDuration="6.163610804s" totalImagesPullingTime="4.005544481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:14:33.162631779 +0000 UTC m=+317.017776663" watchObservedRunningTime="2026-07-13 21:14:33.163610804 +0000 UTC m=+317.018755686"
Jul 13 21:14:33.180472 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:33.180415    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n" podStartSLOduration=1.882856994 podStartE2EDuration="6.180395299s" totalImagesPullingTime="4.297538305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:14:33.177254583 +0000 UTC m=+317.032399489" watchObservedRunningTime="2026-07-13 21:14:33.180395299 +0000 UTC m=+317.035540173"
Jul 13 21:14:33.195653 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:33.195604    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9" podStartSLOduration=2.532206574 podStartE2EDuration="5.195591022s" totalImagesPullingTime="2.663384448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:14:33.194112849 +0000 UTC m=+317.049257732" watchObservedRunningTime="2026-07-13 21:14:33.195591022 +0000 UTC m=+317.050735919"
Jul 13 21:14:37.830942 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.830910    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"]
Jul 13 21:14:37.834328 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.834310    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"
Jul 13 21:14:37.836732 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.836710    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 13 21:14:37.836732 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.836723    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vhwcs\""
Jul 13 21:14:37.840321 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.840296    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"]
Jul 13 21:14:37.844293 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.844275    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"
Jul 13 21:14:37.845189 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.845169    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"]
Jul 13 21:14:37.846272 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.846252    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 13 21:14:37.846536 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.846512    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-m6jnb\""
Jul 13 21:14:37.854575 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.854553    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"]
Jul 13 21:14:37.953437 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.953404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7283185f-f3c1-4851-a750-8a26199e1870-cert\") pod \"kserve-controller-manager-d6f4b65b8-v8thl\" (UID: \"7283185f-f3c1-4851-a750-8a26199e1870\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"
Jul 13 21:14:37.953437 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.953437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e50cfc03-ffa9-4b94-815a-4ad45f2d2736-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8k5t2\" (UID: \"e50cfc03-ffa9-4b94-815a-4ad45f2d2736\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"
Jul 13 21:14:37.953705 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.953462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8jrd\" (UniqueName: \"kubernetes.io/projected/e50cfc03-ffa9-4b94-815a-4ad45f2d2736-kube-api-access-v8jrd\") pod \"llmisvc-controller-manager-777c6bd7d5-8k5t2\" (UID: \"e50cfc03-ffa9-4b94-815a-4ad45f2d2736\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"
Jul 13 21:14:37.953705 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:37.953492    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b79wh\" (UniqueName: \"kubernetes.io/projected/7283185f-f3c1-4851-a750-8a26199e1870-kube-api-access-b79wh\") pod \"kserve-controller-manager-d6f4b65b8-v8thl\" (UID: \"7283185f-f3c1-4851-a750-8a26199e1870\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"
Jul 13 21:14:38.054660 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:38.054626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7283185f-f3c1-4851-a750-8a26199e1870-cert\") pod \"kserve-controller-manager-d6f4b65b8-v8thl\" (UID: \"7283185f-f3c1-4851-a750-8a26199e1870\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"
Jul 13 21:14:38.054851 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:38.054664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e50cfc03-ffa9-4b94-815a-4ad45f2d2736-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8k5t2\" (UID: \"e50cfc03-ffa9-4b94-815a-4ad45f2d2736\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"
Jul 13 21:14:38.054851 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:38.054694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8jrd\" (UniqueName: \"kubernetes.io/projected/e50cfc03-ffa9-4b94-815a-4ad45f2d2736-kube-api-access-v8jrd\") pod \"llmisvc-controller-manager-777c6bd7d5-8k5t2\" (UID: \"e50cfc03-ffa9-4b94-815a-4ad45f2d2736\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"
Jul 13 21:14:38.054851 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:38.054713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b79wh\" (UniqueName: \"kubernetes.io/projected/7283185f-f3c1-4851-a750-8a26199e1870-kube-api-access-b79wh\") pod \"kserve-controller-manager-d6f4b65b8-v8thl\" (UID: \"7283185f-f3c1-4851-a750-8a26199e1870\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"
Jul 13 21:14:38.054851 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:14:38.054803    2580 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 13 21:14:38.055045 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:14:38.054881    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e50cfc03-ffa9-4b94-815a-4ad45f2d2736-cert podName:e50cfc03-ffa9-4b94-815a-4ad45f2d2736 nodeName:}" failed. No retries permitted until 2026-07-13 21:14:38.554863361 +0000 UTC m=+322.410008222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e50cfc03-ffa9-4b94-815a-4ad45f2d2736-cert") pod "llmisvc-controller-manager-777c6bd7d5-8k5t2" (UID: "e50cfc03-ffa9-4b94-815a-4ad45f2d2736") : secret "llmisvc-webhook-server-cert" not found
Jul 13 21:14:38.055045 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:14:38.054803    2580 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 13 21:14:38.055045 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:14:38.054971    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7283185f-f3c1-4851-a750-8a26199e1870-cert podName:7283185f-f3c1-4851-a750-8a26199e1870 nodeName:}" failed. No retries permitted until 2026-07-13 21:14:38.554955098 +0000 UTC m=+322.410099963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7283185f-f3c1-4851-a750-8a26199e1870-cert") pod "kserve-controller-manager-d6f4b65b8-v8thl" (UID: "7283185f-f3c1-4851-a750-8a26199e1870") : secret "kserve-webhook-server-cert" not found
Jul 13 21:14:38.075287 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:38.075262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b79wh\" (UniqueName: \"kubernetes.io/projected/7283185f-f3c1-4851-a750-8a26199e1870-kube-api-access-b79wh\") pod \"kserve-controller-manager-d6f4b65b8-v8thl\" (UID: \"7283185f-f3c1-4851-a750-8a26199e1870\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"
Jul 13 21:14:38.075428 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:38.075370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8jrd\" (UniqueName: \"kubernetes.io/projected/e50cfc03-ffa9-4b94-815a-4ad45f2d2736-kube-api-access-v8jrd\") pod \"llmisvc-controller-manager-777c6bd7d5-8k5t2\" (UID: \"e50cfc03-ffa9-4b94-815a-4ad45f2d2736\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"
Jul 13 21:14:38.558930 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:38.558895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7283185f-f3c1-4851-a750-8a26199e1870-cert\") pod \"kserve-controller-manager-d6f4b65b8-v8thl\" (UID: \"7283185f-f3c1-4851-a750-8a26199e1870\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"
Jul 13 21:14:38.558930 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:38.558930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e50cfc03-ffa9-4b94-815a-4ad45f2d2736-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8k5t2\" (UID: \"e50cfc03-ffa9-4b94-815a-4ad45f2d2736\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"
Jul 13 21:14:38.559139 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:14:38.559046    2580 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 13 21:14:38.559139 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:14:38.559114    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7283185f-f3c1-4851-a750-8a26199e1870-cert podName:7283185f-f3c1-4851-a750-8a26199e1870 nodeName:}" failed. No retries permitted until 2026-07-13 21:14:39.55909849 +0000 UTC m=+323.414243350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7283185f-f3c1-4851-a750-8a26199e1870-cert") pod "kserve-controller-manager-d6f4b65b8-v8thl" (UID: "7283185f-f3c1-4851-a750-8a26199e1870") : secret "kserve-webhook-server-cert" not found
Jul 13 21:14:38.561375 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:38.561344    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e50cfc03-ffa9-4b94-815a-4ad45f2d2736-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8k5t2\" (UID: \"e50cfc03-ffa9-4b94-815a-4ad45f2d2736\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"
Jul 13 21:14:38.756606 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:38.756572    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"
Jul 13 21:14:38.913669 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:38.913646    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"]
Jul 13 21:14:38.915597 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:14:38.915573    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode50cfc03_ffa9_4b94_815a_4ad45f2d2736.slice/crio-e4bf7bb8422ddb2531bc9b0b27cad431c3b1c51e9f20dc7d8e4caa2663f9120e WatchSource:0}: Error finding container e4bf7bb8422ddb2531bc9b0b27cad431c3b1c51e9f20dc7d8e4caa2663f9120e: Status 404 returned error can't find the container with id e4bf7bb8422ddb2531bc9b0b27cad431c3b1c51e9f20dc7d8e4caa2663f9120e
Jul 13 21:14:39.180664 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.180617    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2" event={"ID":"e50cfc03-ffa9-4b94-815a-4ad45f2d2736","Type":"ContainerStarted","Data":"e4bf7bb8422ddb2531bc9b0b27cad431c3b1c51e9f20dc7d8e4caa2663f9120e"}
Jul 13 21:14:39.277405 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.277354    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"]
Jul 13 21:14:39.281031 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.281010    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.283223 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.283199    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4m6cq\""
Jul 13 21:14:39.291952 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.291928    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"]
Jul 13 21:14:39.468124 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.468032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvswq\" (UniqueName: \"kubernetes.io/projected/a2199ec2-c67c-42c1-a5db-11347291d62c-kube-api-access-dvswq\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.468269 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.468144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.468269 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.468183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2199ec2-c67c-42c1-a5db-11347291d62c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.468269 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.468220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.468455 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.468305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2199ec2-c67c-42c1-a5db-11347291d62c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.468455 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.468424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.468542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.468456    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.468583 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.468544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.468583 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.468565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2199ec2-c67c-42c1-a5db-11347291d62c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.570072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.570183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2199ec2-c67c-42c1-a5db-11347291d62c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.570243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.570288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2199ec2-c67c-42c1-a5db-11347291d62c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.570333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7283185f-f3c1-4851-a750-8a26199e1870-cert\") pod \"kserve-controller-manager-d6f4b65b8-v8thl\" (UID: \"7283185f-f3c1-4851-a750-8a26199e1870\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.570402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.570429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.570495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.570526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.570558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2199ec2-c67c-42c1-a5db-11347291d62c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.570613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvswq\" (UniqueName: \"kubernetes.io/projected/a2199ec2-c67c-42c1-a5db-11347291d62c-kube-api-access-dvswq\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.570762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.571032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.571876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.571627    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.573098 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.573069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2199ec2-c67c-42c1-a5db-11347291d62c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.575526 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.575504    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7283185f-f3c1-4851-a750-8a26199e1870-cert\") pod \"kserve-controller-manager-d6f4b65b8-v8thl\" (UID: \"7283185f-f3c1-4851-a750-8a26199e1870\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"
Jul 13 21:14:39.578955 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.578860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2199ec2-c67c-42c1-a5db-11347291d62c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.579291 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.579267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2199ec2-c67c-42c1-a5db-11347291d62c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.581502 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.581480    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2199ec2-c67c-42c1-a5db-11347291d62c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.581796 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.581770    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvswq\" (UniqueName: \"kubernetes.io/projected/a2199ec2-c67c-42c1-a5db-11347291d62c-kube-api-access-dvswq\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gk47m\" (UID: \"a2199ec2-c67c-42c1-a5db-11347291d62c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.591570 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.591547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:39.647427 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:39.647373    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"
Jul 13 21:14:40.505295 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:40.505251    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 21:14:40.505658 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:40.505344    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 21:14:40.580438 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:40.580360    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"]
Jul 13 21:14:40.586316 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:14:40.586276    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7283185f_f3c1_4851_a750_8a26199e1870.slice/crio-abe892139197f6ac46cd7ddbdeef951c998857110f9a1f05b628bb03d035c6de WatchSource:0}: Error finding container abe892139197f6ac46cd7ddbdeef951c998857110f9a1f05b628bb03d035c6de: Status 404 returned error can't find the container with id abe892139197f6ac46cd7ddbdeef951c998857110f9a1f05b628bb03d035c6de
Jul 13 21:14:40.616532 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:40.616496    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"]
Jul 13 21:14:40.618504 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:14:40.618475    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2199ec2_c67c_42c1_a5db_11347291d62c.slice/crio-1ad07debe34192b9943cd9611afd13486c554229106a0bcab392ee6c55b3092d WatchSource:0}: Error finding container 1ad07debe34192b9943cd9611afd13486c554229106a0bcab392ee6c55b3092d: Status 404 returned error can't find the container with id 1ad07debe34192b9943cd9611afd13486c554229106a0bcab392ee6c55b3092d
Jul 13 21:14:41.193093 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:41.193054    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx" event={"ID":"f30ec4aa-2b80-42d6-b046-f6ed4a297400","Type":"ContainerStarted","Data":"077ebe8d074505002c23566416504bc8be9959b121a76a06234d33b83abbce75"}
Jul 13 21:14:41.193290 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:41.193120    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:41.194430 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:41.194368    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl" event={"ID":"7283185f-f3c1-4851-a750-8a26199e1870","Type":"ContainerStarted","Data":"abe892139197f6ac46cd7ddbdeef951c998857110f9a1f05b628bb03d035c6de"}
Jul 13 21:14:41.195275 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:41.195250    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-4bkkx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 21:14:41.195374 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:41.195304    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx" podUID="f30ec4aa-2b80-42d6-b046-f6ed4a297400" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:14:41.195736 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:41.195714    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m" event={"ID":"a2199ec2-c67c-42c1-a5db-11347291d62c","Type":"ContainerStarted","Data":"1ad07debe34192b9943cd9611afd13486c554229106a0bcab392ee6c55b3092d"}
Jul 13 21:14:41.218118 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:41.218062    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx" podStartSLOduration=1.3131184120000001 podStartE2EDuration="12.218043639s" totalImagesPullingTime="10.904925227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:14:41.216351424 +0000 UTC m=+325.071496307" watchObservedRunningTime="2026-07-13 21:14:41.218043639 +0000 UTC m=+325.073188520"
Jul 13 21:14:42.178913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:42.178880    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"]
Jul 13 21:14:42.204476 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:42.204441    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:43.209603 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:43.209465    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx" podUID="f30ec4aa-2b80-42d6-b046-f6ed4a297400" containerName="discovery" containerID="cri-o://077ebe8d074505002c23566416504bc8be9959b121a76a06234d33b83abbce75" gracePeriod=30
Jul 13 21:14:44.156879 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:44.156850    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-8gm2n"
Jul 13 21:14:44.158911 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:44.158887    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zm5t9"
Jul 13 21:14:44.224103 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:44.224070    2580 generic.go:356] "Generic (PLEG): container finished" podID="f30ec4aa-2b80-42d6-b046-f6ed4a297400" containerID="077ebe8d074505002c23566416504bc8be9959b121a76a06234d33b83abbce75" exitCode=0
Jul 13 21:14:44.224463 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:44.224144    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx" event={"ID":"f30ec4aa-2b80-42d6-b046-f6ed4a297400","Type":"ContainerDied","Data":"077ebe8d074505002c23566416504bc8be9959b121a76a06234d33b83abbce75"}
Jul 13 21:14:45.068149 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.068126    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:45.072060 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.072025    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 21:14:45.072139 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.072121    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 21:14:45.072198 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.072172    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 21:14:45.124199 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.124176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-cacerts\") pod \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") "
Jul 13 21:14:45.124323 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.124214    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30ec4aa-2b80-42d6-b046-f6ed4a297400-local-certs\") pod \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") "
Jul 13 21:14:45.124323 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.124235    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-kubeconfig\") pod \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") "
Jul 13 21:14:45.124323 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.124266    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-csr-ca-configmap\") pod \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") "
Jul 13 21:14:45.124323 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.124285    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pzg4\" (UniqueName: \"kubernetes.io/projected/f30ec4aa-2b80-42d6-b046-f6ed4a297400-kube-api-access-8pzg4\") pod \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") "
Jul 13 21:14:45.124323 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.124301    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-token\") pod \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") "
Jul 13 21:14:45.124761 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.124732    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f30ec4aa-2b80-42d6-b046-f6ed4a297400" (UID: "f30ec4aa-2b80-42d6-b046-f6ed4a297400"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:14:45.124837 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.124790    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-csr-dns-cert\") pod \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\" (UID: \"f30ec4aa-2b80-42d6-b046-f6ed4a297400\") "
Jul 13 21:14:45.125160 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.125138    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-csr-ca-configmap\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:14:45.126901 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.126873    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-cacerts" (OuterVolumeSpecName: "cacerts") pod "f30ec4aa-2b80-42d6-b046-f6ed4a297400" (UID: "f30ec4aa-2b80-42d6-b046-f6ed4a297400"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:14:45.126992 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.126930    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f30ec4aa-2b80-42d6-b046-f6ed4a297400" (UID: "f30ec4aa-2b80-42d6-b046-f6ed4a297400"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:14:45.127079 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.127060    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-token" (OuterVolumeSpecName: "istio-token") pod "f30ec4aa-2b80-42d6-b046-f6ed4a297400" (UID: "f30ec4aa-2b80-42d6-b046-f6ed4a297400"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:14:45.127154 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.127096    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30ec4aa-2b80-42d6-b046-f6ed4a297400-local-certs" (OuterVolumeSpecName: "local-certs") pod "f30ec4aa-2b80-42d6-b046-f6ed4a297400" (UID: "f30ec4aa-2b80-42d6-b046-f6ed4a297400"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:14:45.127215 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.127194    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30ec4aa-2b80-42d6-b046-f6ed4a297400-kube-api-access-8pzg4" (OuterVolumeSpecName: "kube-api-access-8pzg4") pod "f30ec4aa-2b80-42d6-b046-f6ed4a297400" (UID: "f30ec4aa-2b80-42d6-b046-f6ed4a297400"). InnerVolumeSpecName "kube-api-access-8pzg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:14:45.127458 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.127440    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f30ec4aa-2b80-42d6-b046-f6ed4a297400" (UID: "f30ec4aa-2b80-42d6-b046-f6ed4a297400"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:14:45.225979 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.225930    2580 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-cacerts\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:14:45.225979 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.225962    2580 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30ec4aa-2b80-42d6-b046-f6ed4a297400-local-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:14:45.225979 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.225977    2580 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-kubeconfig\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:14:45.226495 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.225991    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pzg4\" (UniqueName: \"kubernetes.io/projected/f30ec4aa-2b80-42d6-b046-f6ed4a297400-kube-api-access-8pzg4\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:14:45.226495 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.226004    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:14:45.226495 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.226017    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f30ec4aa-2b80-42d6-b046-f6ed4a297400-istio-csr-dns-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:14:45.232792 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.232743    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl" event={"ID":"7283185f-f3c1-4851-a750-8a26199e1870","Type":"ContainerStarted","Data":"232e2af8e412d2b6df94f6893fc10856c1eff32c13f4e1ae509fa6fe253564c9"}
Jul 13 21:14:45.233036 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.233004    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"
Jul 13 21:14:45.234754 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.234695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2" event={"ID":"e50cfc03-ffa9-4b94-815a-4ad45f2d2736","Type":"ContainerStarted","Data":"e54ab0a9809f661b9dfd9ad6213633a62d2e73097e7762d03589257a3a612aad"}
Jul 13 21:14:45.234942 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.234918    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"
Jul 13 21:14:45.236770 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.236710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m" event={"ID":"a2199ec2-c67c-42c1-a5db-11347291d62c","Type":"ContainerStarted","Data":"e284e3a81303128eac4d46465c647cc47467a77c26d84ac7af35db29cce49205"}
Jul 13 21:14:45.238326 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.238305    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx" event={"ID":"f30ec4aa-2b80-42d6-b046-f6ed4a297400","Type":"ContainerDied","Data":"06e783c3a1a0a44db16b58ccb72c30b30c3c7a570323e4fbecbf2a68430f06c6"}
Jul 13 21:14:45.238443 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.238346    2580 scope.go:117] "RemoveContainer" containerID="077ebe8d074505002c23566416504bc8be9959b121a76a06234d33b83abbce75"
Jul 13 21:14:45.238443 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.238353    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"
Jul 13 21:14:45.269994 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.269945    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m" podStartSLOduration=1.819381297 podStartE2EDuration="6.269927923s" totalImagesPullingTime="4.450546626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:14:45.269102739 +0000 UTC m=+329.124247623" watchObservedRunningTime="2026-07-13 21:14:45.269927923 +0000 UTC m=+329.125072799"
Jul 13 21:14:45.270955 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.270918    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl" podStartSLOduration=3.787614593 podStartE2EDuration="8.270906196s" totalImagesPullingTime="4.483291603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:14:45.249165771 +0000 UTC m=+329.104310660" watchObservedRunningTime="2026-07-13 21:14:45.270906196 +0000 UTC m=+329.126051077"
Jul 13 21:14:45.288614 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.288570    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2" podStartSLOduration=2.131615167 podStartE2EDuration="8.288555993s" totalImagesPullingTime="6.156940826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:14:45.286496803 +0000 UTC m=+329.141641696" watchObservedRunningTime="2026-07-13 21:14:45.288555993 +0000 UTC m=+329.143700875"
Jul 13 21:14:45.300450 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.300368    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"]
Jul 13 21:14:45.305718 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.305688    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4bkkx"]
Jul 13 21:14:45.592313 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:45.592239    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:46.597068 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:46.597040    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:46.714277 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:46.714242    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f30ec4aa-2b80-42d6-b046-f6ed4a297400" path="/var/lib/kubelet/pods/f30ec4aa-2b80-42d6-b046-f6ed4a297400/volumes"
Jul 13 21:14:47.251463 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:47.251429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:14:47.252319 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:14:47.252304    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gk47m"
Jul 13 21:15:16.248771 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:16.248682    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8k5t2"
Jul 13 21:15:16.251759 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:16.251736    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8thl"
Jul 13 21:15:28.760787 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:28.760757    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9gs4s"]
Jul 13 21:15:28.761252 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:28.761125    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30ec4aa-2b80-42d6-b046-f6ed4a297400" containerName="discovery"
Jul 13 21:15:28.761252 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:28.761135    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30ec4aa-2b80-42d6-b046-f6ed4a297400" containerName="discovery"
Jul 13 21:15:28.761252 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:28.761212    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f30ec4aa-2b80-42d6-b046-f6ed4a297400" containerName="discovery"
Jul 13 21:15:28.770435 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:28.770409    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9gs4s"
Jul 13 21:15:28.772720 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:28.772698    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 21:15:28.773280 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:28.773262    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 21:15:28.773371 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:28.773319    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-x6g58\""
Jul 13 21:15:28.776606 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:28.776583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9gs4s"]
Jul 13 21:15:28.900047 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:28.900006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hm8m\" (UniqueName: \"kubernetes.io/projected/e16d7523-4004-423e-99c1-be0f2d0ca2f2-kube-api-access-9hm8m\") pod \"kuadrant-operator-catalog-9gs4s\" (UID: \"e16d7523-4004-423e-99c1-be0f2d0ca2f2\") " pod="kuadrant-system/kuadrant-operator-catalog-9gs4s"
Jul 13 21:15:29.001590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.001553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hm8m\" (UniqueName: \"kubernetes.io/projected/e16d7523-4004-423e-99c1-be0f2d0ca2f2-kube-api-access-9hm8m\") pod \"kuadrant-operator-catalog-9gs4s\" (UID: \"e16d7523-4004-423e-99c1-be0f2d0ca2f2\") " pod="kuadrant-system/kuadrant-operator-catalog-9gs4s"
Jul 13 21:15:29.009500 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.009470    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hm8m\" (UniqueName: \"kubernetes.io/projected/e16d7523-4004-423e-99c1-be0f2d0ca2f2-kube-api-access-9hm8m\") pod \"kuadrant-operator-catalog-9gs4s\" (UID: \"e16d7523-4004-423e-99c1-be0f2d0ca2f2\") " pod="kuadrant-system/kuadrant-operator-catalog-9gs4s"
Jul 13 21:15:29.082010 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.081942    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9gs4s"
Jul 13 21:15:29.124690 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.124656    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9gs4s"]
Jul 13 21:15:29.210546 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.210520    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9gs4s"]
Jul 13 21:15:29.212403 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:15:29.212351    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16d7523_4004_423e_99c1_be0f2d0ca2f2.slice/crio-95a4869a156c627e80da2e1f24ec58252216d1c1c4514549b39081b9275ec3dc WatchSource:0}: Error finding container 95a4869a156c627e80da2e1f24ec58252216d1c1c4514549b39081b9275ec3dc: Status 404 returned error can't find the container with id 95a4869a156c627e80da2e1f24ec58252216d1c1c4514549b39081b9275ec3dc
Jul 13 21:15:29.333082 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.333004    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5fppf"]
Jul 13 21:15:29.336032 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.336015    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5fppf"
Jul 13 21:15:29.343563 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.343540    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5fppf"]
Jul 13 21:15:29.462813 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.462780    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9gs4s" event={"ID":"e16d7523-4004-423e-99c1-be0f2d0ca2f2","Type":"ContainerStarted","Data":"95a4869a156c627e80da2e1f24ec58252216d1c1c4514549b39081b9275ec3dc"}
Jul 13 21:15:29.504773 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.504737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckrxk\" (UniqueName: \"kubernetes.io/projected/4f121656-0e1e-4fa4-a0e5-25e2a7110e92-kube-api-access-ckrxk\") pod \"kuadrant-operator-catalog-5fppf\" (UID: \"4f121656-0e1e-4fa4-a0e5-25e2a7110e92\") " pod="kuadrant-system/kuadrant-operator-catalog-5fppf"
Jul 13 21:15:29.605535 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.605451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckrxk\" (UniqueName: \"kubernetes.io/projected/4f121656-0e1e-4fa4-a0e5-25e2a7110e92-kube-api-access-ckrxk\") pod \"kuadrant-operator-catalog-5fppf\" (UID: \"4f121656-0e1e-4fa4-a0e5-25e2a7110e92\") " pod="kuadrant-system/kuadrant-operator-catalog-5fppf"
Jul 13 21:15:29.613327 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.613298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckrxk\" (UniqueName: \"kubernetes.io/projected/4f121656-0e1e-4fa4-a0e5-25e2a7110e92-kube-api-access-ckrxk\") pod \"kuadrant-operator-catalog-5fppf\" (UID: \"4f121656-0e1e-4fa4-a0e5-25e2a7110e92\") " pod="kuadrant-system/kuadrant-operator-catalog-5fppf"
Jul 13 21:15:29.646296 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.646268    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5fppf"
Jul 13 21:15:29.777575 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:29.777551    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5fppf"]
Jul 13 21:15:29.779648 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:15:29.779621    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f121656_0e1e_4fa4_a0e5_25e2a7110e92.slice/crio-972c40cb66ecc955fa1a290287f6519dc001bdb38702b7141f0c1eb1e67612f5 WatchSource:0}: Error finding container 972c40cb66ecc955fa1a290287f6519dc001bdb38702b7141f0c1eb1e67612f5: Status 404 returned error can't find the container with id 972c40cb66ecc955fa1a290287f6519dc001bdb38702b7141f0c1eb1e67612f5
Jul 13 21:15:30.471538 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:30.471496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5fppf" event={"ID":"4f121656-0e1e-4fa4-a0e5-25e2a7110e92","Type":"ContainerStarted","Data":"972c40cb66ecc955fa1a290287f6519dc001bdb38702b7141f0c1eb1e67612f5"}
Jul 13 21:15:32.482848 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:32.482810    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5fppf" event={"ID":"4f121656-0e1e-4fa4-a0e5-25e2a7110e92","Type":"ContainerStarted","Data":"464ec5569e118bfa72b015572d7f47354911411192e1914bb9a187b6c6a8800f"}
Jul 13 21:15:32.484395 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:32.484353    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9gs4s" event={"ID":"e16d7523-4004-423e-99c1-be0f2d0ca2f2","Type":"ContainerStarted","Data":"1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5"}
Jul 13 21:15:32.484395 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:32.484364    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9gs4s" podUID="e16d7523-4004-423e-99c1-be0f2d0ca2f2" containerName="registry-server" containerID="cri-o://1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5" gracePeriod=2
Jul 13 21:15:32.498898 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:32.498861    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5fppf" podStartSLOduration=1.6448766510000001 podStartE2EDuration="3.4988463s" totalImagesPullingTime="1.853969649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:15:32.496682455 +0000 UTC m=+376.351827337" watchObservedRunningTime="2026-07-13 21:15:32.4988463 +0000 UTC m=+376.353991181"
Jul 13 21:15:32.511278 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:32.511239    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9gs4s" podStartSLOduration=2.092659852 podStartE2EDuration="4.511224958s" totalImagesPullingTime="2.418565106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:15:32.51001395 +0000 UTC m=+376.365158833" watchObservedRunningTime="2026-07-13 21:15:32.511224958 +0000 UTC m=+376.366369839"
Jul 13 21:15:32.737292 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:32.737233    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9gs4s"
Jul 13 21:15:32.835783 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:32.835752    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hm8m\" (UniqueName: \"kubernetes.io/projected/e16d7523-4004-423e-99c1-be0f2d0ca2f2-kube-api-access-9hm8m\") pod \"e16d7523-4004-423e-99c1-be0f2d0ca2f2\" (UID: \"e16d7523-4004-423e-99c1-be0f2d0ca2f2\") "
Jul 13 21:15:32.837871 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:32.837842    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e16d7523-4004-423e-99c1-be0f2d0ca2f2-kube-api-access-9hm8m" (OuterVolumeSpecName: "kube-api-access-9hm8m") pod "e16d7523-4004-423e-99c1-be0f2d0ca2f2" (UID: "e16d7523-4004-423e-99c1-be0f2d0ca2f2"). InnerVolumeSpecName "kube-api-access-9hm8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:15:32.937027 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:32.936999    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hm8m\" (UniqueName: \"kubernetes.io/projected/e16d7523-4004-423e-99c1-be0f2d0ca2f2-kube-api-access-9hm8m\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:33.490621 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:33.490584    2580 generic.go:356] "Generic (PLEG): container finished" podID="e16d7523-4004-423e-99c1-be0f2d0ca2f2" containerID="1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5" exitCode=0
Jul 13 21:15:33.491009 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:33.490632    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9gs4s"
Jul 13 21:15:33.491009 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:33.490677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9gs4s" event={"ID":"e16d7523-4004-423e-99c1-be0f2d0ca2f2","Type":"ContainerDied","Data":"1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5"}
Jul 13 21:15:33.491009 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:33.490738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9gs4s" event={"ID":"e16d7523-4004-423e-99c1-be0f2d0ca2f2","Type":"ContainerDied","Data":"95a4869a156c627e80da2e1f24ec58252216d1c1c4514549b39081b9275ec3dc"}
Jul 13 21:15:33.491009 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:33.490769    2580 scope.go:117] "RemoveContainer" containerID="1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5"
Jul 13 21:15:33.500474 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:33.500433    2580 scope.go:117] "RemoveContainer" containerID="1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5"
Jul 13 21:15:33.500673 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:15:33.500657    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5\": container with ID starting with 1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5 not found: ID does not exist" containerID="1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5"
Jul 13 21:15:33.500720 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:33.500679    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5"} err="failed to get container status \"1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5\": rpc error: code = NotFound desc = could not find container \"1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5\": container with ID starting with 1865b6c07eb5eb5d7c465af0d1976e1459d63b29bfe653f5ed9d86358fb925a5 not found: ID does not exist"
Jul 13 21:15:33.511640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:33.511608    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9gs4s"]
Jul 13 21:15:33.513747 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:33.513727    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9gs4s"]
Jul 13 21:15:34.713783 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:34.713753    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e16d7523-4004-423e-99c1-be0f2d0ca2f2" path="/var/lib/kubelet/pods/e16d7523-4004-423e-99c1-be0f2d0ca2f2/volumes"
Jul 13 21:15:39.646541 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:39.646504    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5fppf"
Jul 13 21:15:39.647034 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:39.646571    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5fppf"
Jul 13 21:15:39.669848 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:39.669822    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5fppf"
Jul 13 21:15:40.548480 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:40.548451    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5fppf"
Jul 13 21:15:44.575859 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.575826    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"]
Jul 13 21:15:44.576222 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.576185    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e16d7523-4004-423e-99c1-be0f2d0ca2f2" containerName="registry-server"
Jul 13 21:15:44.576222 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.576196    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e16d7523-4004-423e-99c1-be0f2d0ca2f2" containerName="registry-server"
Jul 13 21:15:44.576294 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.576279    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e16d7523-4004-423e-99c1-be0f2d0ca2f2" containerName="registry-server"
Jul 13 21:15:44.579548 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.579530    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:44.581983 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.581961    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jctlp\""
Jul 13 21:15:44.588303 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.588276    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"]
Jul 13 21:15:44.641170 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.641131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br2xq\" (UniqueName: \"kubernetes.io/projected/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-kube-api-access-br2xq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw\" (UID: \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:44.641170 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.641168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw\" (UID: \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:44.641360 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.641246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw\" (UID: \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:44.742210 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.742179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br2xq\" (UniqueName: \"kubernetes.io/projected/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-kube-api-access-br2xq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw\" (UID: \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:44.742210 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.742217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw\" (UID: \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:44.742441 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.742255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw\" (UID: \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:44.742673 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.742656    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw\" (UID: \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:44.742713 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.742686    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw\" (UID: \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:44.750448 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.750420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br2xq\" (UniqueName: \"kubernetes.io/projected/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-kube-api-access-br2xq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw\" (UID: \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:44.889768 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:44.889746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:45.018696 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.018656    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"]
Jul 13 21:15:45.020893 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:15:45.020863    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0799b09f_1be8_4e0f_b5f5_3cdf3ede4c51.slice/crio-c887f1cebb0ea397cc69f61147540e90a75e8a0a77ea0aacd98f39067d3ce687 WatchSource:0}: Error finding container c887f1cebb0ea397cc69f61147540e90a75e8a0a77ea0aacd98f39067d3ce687: Status 404 returned error can't find the container with id c887f1cebb0ea397cc69f61147540e90a75e8a0a77ea0aacd98f39067d3ce687
Jul 13 21:15:45.170248 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.170178    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"]
Jul 13 21:15:45.173897 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.173876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:45.180858 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.180836    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"]
Jul 13 21:15:45.247017 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.246982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/642421ee-dd9f-41c6-97d2-15566d3063a1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v\" (UID: \"642421ee-dd9f-41c6-97d2-15566d3063a1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:45.247017 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.247016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/642421ee-dd9f-41c6-97d2-15566d3063a1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v\" (UID: \"642421ee-dd9f-41c6-97d2-15566d3063a1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:45.247221 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.247045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krx66\" (UniqueName: \"kubernetes.io/projected/642421ee-dd9f-41c6-97d2-15566d3063a1-kube-api-access-krx66\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v\" (UID: \"642421ee-dd9f-41c6-97d2-15566d3063a1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:45.348005 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.347973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krx66\" (UniqueName: \"kubernetes.io/projected/642421ee-dd9f-41c6-97d2-15566d3063a1-kube-api-access-krx66\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v\" (UID: \"642421ee-dd9f-41c6-97d2-15566d3063a1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:45.348168 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.348081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/642421ee-dd9f-41c6-97d2-15566d3063a1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v\" (UID: \"642421ee-dd9f-41c6-97d2-15566d3063a1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:45.348168 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.348101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/642421ee-dd9f-41c6-97d2-15566d3063a1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v\" (UID: \"642421ee-dd9f-41c6-97d2-15566d3063a1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:45.348463 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.348447    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/642421ee-dd9f-41c6-97d2-15566d3063a1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v\" (UID: \"642421ee-dd9f-41c6-97d2-15566d3063a1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:45.348507 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.348493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/642421ee-dd9f-41c6-97d2-15566d3063a1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v\" (UID: \"642421ee-dd9f-41c6-97d2-15566d3063a1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:45.363049 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.363024    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krx66\" (UniqueName: \"kubernetes.io/projected/642421ee-dd9f-41c6-97d2-15566d3063a1-kube-api-access-krx66\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v\" (UID: \"642421ee-dd9f-41c6-97d2-15566d3063a1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:45.494284 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.494198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:45.554161 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.554119    2580 generic.go:356] "Generic (PLEG): container finished" podID="0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" containerID="a385a697a058f037f6185b8c527749f77a4c9959f3a462dfe0440c5ca3dce579" exitCode=0
Jul 13 21:15:45.554298 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.554187    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw" event={"ID":"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51","Type":"ContainerDied","Data":"a385a697a058f037f6185b8c527749f77a4c9959f3a462dfe0440c5ca3dce579"}
Jul 13 21:15:45.554298 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.554251    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw" event={"ID":"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51","Type":"ContainerStarted","Data":"c887f1cebb0ea397cc69f61147540e90a75e8a0a77ea0aacd98f39067d3ce687"}
Jul 13 21:15:45.582291 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.582265    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"]
Jul 13 21:15:45.587123 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.587099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:45.593718 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.593694    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"]
Jul 13 21:15:45.631139 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.631114    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"]
Jul 13 21:15:45.633020 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:15:45.632988    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642421ee_dd9f_41c6_97d2_15566d3063a1.slice/crio-dd054940fee559ca4ca32f62706c340945279a084cf71882796654a3beaadcf4 WatchSource:0}: Error finding container dd054940fee559ca4ca32f62706c340945279a084cf71882796654a3beaadcf4: Status 404 returned error can't find the container with id dd054940fee559ca4ca32f62706c340945279a084cf71882796654a3beaadcf4
Jul 13 21:15:45.650821 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.650799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm\" (UID: \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:45.650915 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.650848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm\" (UID: \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:45.650915 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.650883    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vjtn\" (UniqueName: \"kubernetes.io/projected/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-kube-api-access-6vjtn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm\" (UID: \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:45.752276 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.752211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm\" (UID: \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:45.752276 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.752252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm\" (UID: \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:45.752439 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.752280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vjtn\" (UniqueName: \"kubernetes.io/projected/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-kube-api-access-6vjtn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm\" (UID: \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:45.752692 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.752660    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm\" (UID: \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:45.752727 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.752699    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm\" (UID: \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:45.760331 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.760308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vjtn\" (UniqueName: \"kubernetes.io/projected/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-kube-api-access-6vjtn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm\" (UID: \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:45.899424 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:45.899372    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:46.031694 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.031673    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"]
Jul 13 21:15:46.033320 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:15:46.033296    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8931a2_e5aa_4cc1_b93e_6f72dbc653b4.slice/crio-56f736f113fd354a6186f33ca430c93ba92a83b8ff9dc2616897cb0efa9bba67 WatchSource:0}: Error finding container 56f736f113fd354a6186f33ca430c93ba92a83b8ff9dc2616897cb0efa9bba67: Status 404 returned error can't find the container with id 56f736f113fd354a6186f33ca430c93ba92a83b8ff9dc2616897cb0efa9bba67
Jul 13 21:15:46.172157 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.172127    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"]
Jul 13 21:15:46.175881 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.175862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:46.183277 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.183255    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"]
Jul 13 21:15:46.257375 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.257347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddea4336-870e-4c02-a7e4-288c10d5fbc2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq\" (UID: \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:46.257527 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.257473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bzff\" (UniqueName: \"kubernetes.io/projected/ddea4336-870e-4c02-a7e4-288c10d5fbc2-kube-api-access-8bzff\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq\" (UID: \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:46.257527 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.257513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddea4336-870e-4c02-a7e4-288c10d5fbc2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq\" (UID: \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:46.358154 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.358078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddea4336-870e-4c02-a7e4-288c10d5fbc2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq\" (UID: \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:46.358154 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.358138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bzff\" (UniqueName: \"kubernetes.io/projected/ddea4336-870e-4c02-a7e4-288c10d5fbc2-kube-api-access-8bzff\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq\" (UID: \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:46.358326 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.358162    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddea4336-870e-4c02-a7e4-288c10d5fbc2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq\" (UID: \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:46.358506 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.358486    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddea4336-870e-4c02-a7e4-288c10d5fbc2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq\" (UID: \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:46.358559 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.358544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddea4336-870e-4c02-a7e4-288c10d5fbc2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq\" (UID: \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:46.376223 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.376192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bzff\" (UniqueName: \"kubernetes.io/projected/ddea4336-870e-4c02-a7e4-288c10d5fbc2-kube-api-access-8bzff\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq\" (UID: \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:46.517430 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.517399    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:46.560564 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.560528    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" containerID="51c6f029c3bc2f12baf44482198abaa3b8ffb512b36eef706e6e3f32ed1f47c6" exitCode=0
Jul 13 21:15:46.560697 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.560614    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm" event={"ID":"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4","Type":"ContainerDied","Data":"51c6f029c3bc2f12baf44482198abaa3b8ffb512b36eef706e6e3f32ed1f47c6"}
Jul 13 21:15:46.560697 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.560667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm" event={"ID":"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4","Type":"ContainerStarted","Data":"56f736f113fd354a6186f33ca430c93ba92a83b8ff9dc2616897cb0efa9bba67"}
Jul 13 21:15:46.564195 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.563023    2580 generic.go:356] "Generic (PLEG): container finished" podID="642421ee-dd9f-41c6-97d2-15566d3063a1" containerID="c6c9fc089e7a782aa7a0a10a1cb34cda142991063fada426a8be464284d072be" exitCode=0
Jul 13 21:15:46.564195 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.563096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v" event={"ID":"642421ee-dd9f-41c6-97d2-15566d3063a1","Type":"ContainerDied","Data":"c6c9fc089e7a782aa7a0a10a1cb34cda142991063fada426a8be464284d072be"}
Jul 13 21:15:46.564195 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.563132    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v" event={"ID":"642421ee-dd9f-41c6-97d2-15566d3063a1","Type":"ContainerStarted","Data":"dd054940fee559ca4ca32f62706c340945279a084cf71882796654a3beaadcf4"}
Jul 13 21:15:46.665884 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:46.665853    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"]
Jul 13 21:15:46.667311 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:15:46.667286    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddea4336_870e_4c02_a7e4_288c10d5fbc2.slice/crio-b4ec5bcf9c8584bbbb1c5b1585e2e54a7ef37d555114a68de2336a5b00b933e0 WatchSource:0}: Error finding container b4ec5bcf9c8584bbbb1c5b1585e2e54a7ef37d555114a68de2336a5b00b933e0: Status 404 returned error can't find the container with id b4ec5bcf9c8584bbbb1c5b1585e2e54a7ef37d555114a68de2336a5b00b933e0
Jul 13 21:15:47.569448 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:47.569418    2580 generic.go:356] "Generic (PLEG): container finished" podID="ddea4336-870e-4c02-a7e4-288c10d5fbc2" containerID="c6fd48406abecc35cf99ff854ebe31c9a2d07455c56e4b048a6bbf465ab9d896" exitCode=0
Jul 13 21:15:47.569615 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:47.569503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq" event={"ID":"ddea4336-870e-4c02-a7e4-288c10d5fbc2","Type":"ContainerDied","Data":"c6fd48406abecc35cf99ff854ebe31c9a2d07455c56e4b048a6bbf465ab9d896"}
Jul 13 21:15:47.569615 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:47.569564    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq" event={"ID":"ddea4336-870e-4c02-a7e4-288c10d5fbc2","Type":"ContainerStarted","Data":"b4ec5bcf9c8584bbbb1c5b1585e2e54a7ef37d555114a68de2336a5b00b933e0"}
Jul 13 21:15:47.571272 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:47.571251    2580 generic.go:356] "Generic (PLEG): container finished" podID="0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" containerID="e57172e421d38d00f245934c01af02c381eb3a8098161264f64a1f3420185c9d" exitCode=0
Jul 13 21:15:47.571418 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:47.571332    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw" event={"ID":"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51","Type":"ContainerDied","Data":"e57172e421d38d00f245934c01af02c381eb3a8098161264f64a1f3420185c9d"}
Jul 13 21:15:48.578229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:48.578195    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" containerID="858e8cd92c36440eec6b01e2ace2eee2acc9bcb57cefba06c65879cc77af6029" exitCode=0
Jul 13 21:15:48.578635 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:48.578274    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm" event={"ID":"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4","Type":"ContainerDied","Data":"858e8cd92c36440eec6b01e2ace2eee2acc9bcb57cefba06c65879cc77af6029"}
Jul 13 21:15:48.580206 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:48.580185    2580 generic.go:356] "Generic (PLEG): container finished" podID="642421ee-dd9f-41c6-97d2-15566d3063a1" containerID="d2ab389fef2c202fa37b75ba4a75d73c5bd188815281436943faead17353df68" exitCode=0
Jul 13 21:15:48.580303 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:48.580248    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v" event={"ID":"642421ee-dd9f-41c6-97d2-15566d3063a1","Type":"ContainerDied","Data":"d2ab389fef2c202fa37b75ba4a75d73c5bd188815281436943faead17353df68"}
Jul 13 21:15:48.582077 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:48.582058    2580 generic.go:356] "Generic (PLEG): container finished" podID="ddea4336-870e-4c02-a7e4-288c10d5fbc2" containerID="955866b7fcb7f2e01b954100033f3b63dd9206b48699ad95b623c89efb4c452f" exitCode=0
Jul 13 21:15:48.582153 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:48.582083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq" event={"ID":"ddea4336-870e-4c02-a7e4-288c10d5fbc2","Type":"ContainerDied","Data":"955866b7fcb7f2e01b954100033f3b63dd9206b48699ad95b623c89efb4c452f"}
Jul 13 21:15:48.588866 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:48.588837    2580 generic.go:356] "Generic (PLEG): container finished" podID="0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" containerID="1b30f0e2e7711c2de989d9913a82cd269c05f1389b03c1b9138ae4f98eccf0c9" exitCode=0
Jul 13 21:15:48.588964 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:48.588893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw" event={"ID":"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51","Type":"ContainerDied","Data":"1b30f0e2e7711c2de989d9913a82cd269c05f1389b03c1b9138ae4f98eccf0c9"}
Jul 13 21:15:49.596294 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.596260    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" containerID="b6cfe66620fb8cbfbbc9d3330e795e7c21cb9fde49f96465374ea2dc7f5eca7f" exitCode=0
Jul 13 21:15:49.596720 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.596358    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm" event={"ID":"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4","Type":"ContainerDied","Data":"b6cfe66620fb8cbfbbc9d3330e795e7c21cb9fde49f96465374ea2dc7f5eca7f"}
Jul 13 21:15:49.598334 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.598310    2580 generic.go:356] "Generic (PLEG): container finished" podID="642421ee-dd9f-41c6-97d2-15566d3063a1" containerID="fc96a482c6c23bea8c3829ed0fc59a6395aff3c2fe6551389c89a43a4b3d954b" exitCode=0
Jul 13 21:15:49.598480 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.598372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v" event={"ID":"642421ee-dd9f-41c6-97d2-15566d3063a1","Type":"ContainerDied","Data":"fc96a482c6c23bea8c3829ed0fc59a6395aff3c2fe6551389c89a43a4b3d954b"}
Jul 13 21:15:49.600510 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.600489    2580 generic.go:356] "Generic (PLEG): container finished" podID="ddea4336-870e-4c02-a7e4-288c10d5fbc2" containerID="a93893f30e163b0f58ae84e59a66aa670a86ca7e2ff27679012a00857e79bcae" exitCode=0
Jul 13 21:15:49.600610 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.600573    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq" event={"ID":"ddea4336-870e-4c02-a7e4-288c10d5fbc2","Type":"ContainerDied","Data":"a93893f30e163b0f58ae84e59a66aa670a86ca7e2ff27679012a00857e79bcae"}
Jul 13 21:15:49.735421 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.735399    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:49.787195 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.787160    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-util\") pod \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\" (UID: \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\") "
Jul 13 21:15:49.787354 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.787220    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-bundle\") pod \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\" (UID: \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\") "
Jul 13 21:15:49.787354 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.787251    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-br2xq\" (UniqueName: \"kubernetes.io/projected/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-kube-api-access-br2xq\") pod \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\" (UID: \"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51\") "
Jul 13 21:15:49.787804 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.787769    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-bundle" (OuterVolumeSpecName: "bundle") pod "0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" (UID: "0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:15:49.789322 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.789298    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-kube-api-access-br2xq" (OuterVolumeSpecName: "kube-api-access-br2xq") pod "0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" (UID: "0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51"). InnerVolumeSpecName "kube-api-access-br2xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:15:49.795093 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.795067    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-util" (OuterVolumeSpecName: "util") pod "0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" (UID: "0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:15:49.888779 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.888756    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-util\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:49.888779 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.888781    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:49.888933 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:49.888791    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br2xq\" (UniqueName: \"kubernetes.io/projected/0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51-kube-api-access-br2xq\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:50.608195 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.608163    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw"
Jul 13 21:15:50.608651 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.608205    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw" event={"ID":"0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51","Type":"ContainerDied","Data":"c887f1cebb0ea397cc69f61147540e90a75e8a0a77ea0aacd98f39067d3ce687"}
Jul 13 21:15:50.608651 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.608250    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c887f1cebb0ea397cc69f61147540e90a75e8a0a77ea0aacd98f39067d3ce687"
Jul 13 21:15:50.768154 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.768126    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:50.794683 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.794658    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:50.797015 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.796993    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krx66\" (UniqueName: \"kubernetes.io/projected/642421ee-dd9f-41c6-97d2-15566d3063a1-kube-api-access-krx66\") pod \"642421ee-dd9f-41c6-97d2-15566d3063a1\" (UID: \"642421ee-dd9f-41c6-97d2-15566d3063a1\") "
Jul 13 21:15:50.797121 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.797032    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/642421ee-dd9f-41c6-97d2-15566d3063a1-bundle\") pod \"642421ee-dd9f-41c6-97d2-15566d3063a1\" (UID: \"642421ee-dd9f-41c6-97d2-15566d3063a1\") "
Jul 13 21:15:50.797186 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.797148    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/642421ee-dd9f-41c6-97d2-15566d3063a1-util\") pod \"642421ee-dd9f-41c6-97d2-15566d3063a1\" (UID: \"642421ee-dd9f-41c6-97d2-15566d3063a1\") "
Jul 13 21:15:50.797651 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.797613    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642421ee-dd9f-41c6-97d2-15566d3063a1-bundle" (OuterVolumeSpecName: "bundle") pod "642421ee-dd9f-41c6-97d2-15566d3063a1" (UID: "642421ee-dd9f-41c6-97d2-15566d3063a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:15:50.798009 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.797987    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:50.799154 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.799131    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/642421ee-dd9f-41c6-97d2-15566d3063a1-kube-api-access-krx66" (OuterVolumeSpecName: "kube-api-access-krx66") pod "642421ee-dd9f-41c6-97d2-15566d3063a1" (UID: "642421ee-dd9f-41c6-97d2-15566d3063a1"). InnerVolumeSpecName "kube-api-access-krx66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:15:50.806342 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.806318    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642421ee-dd9f-41c6-97d2-15566d3063a1-util" (OuterVolumeSpecName: "util") pod "642421ee-dd9f-41c6-97d2-15566d3063a1" (UID: "642421ee-dd9f-41c6-97d2-15566d3063a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:15:50.897594 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.897570    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-bundle\") pod \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\" (UID: \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\") "
Jul 13 21:15:50.897742 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.897624    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-util\") pod \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\" (UID: \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\") "
Jul 13 21:15:50.897742 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.897646    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bzff\" (UniqueName: \"kubernetes.io/projected/ddea4336-870e-4c02-a7e4-288c10d5fbc2-kube-api-access-8bzff\") pod \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\" (UID: \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\") "
Jul 13 21:15:50.897742 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.897670    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vjtn\" (UniqueName: \"kubernetes.io/projected/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-kube-api-access-6vjtn\") pod \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\" (UID: \"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4\") "
Jul 13 21:15:50.897742 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.897687    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddea4336-870e-4c02-a7e4-288c10d5fbc2-util\") pod \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\" (UID: \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\") "
Jul 13 21:15:50.897950 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.897746    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddea4336-870e-4c02-a7e4-288c10d5fbc2-bundle\") pod \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\" (UID: \"ddea4336-870e-4c02-a7e4-288c10d5fbc2\") "
Jul 13 21:15:50.898054 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.898024    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/642421ee-dd9f-41c6-97d2-15566d3063a1-util\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:50.898123 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.898057    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krx66\" (UniqueName: \"kubernetes.io/projected/642421ee-dd9f-41c6-97d2-15566d3063a1-kube-api-access-krx66\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:50.898123 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.898072    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/642421ee-dd9f-41c6-97d2-15566d3063a1-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:50.898456 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.898427    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-bundle" (OuterVolumeSpecName: "bundle") pod "7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" (UID: "7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:15:50.898705 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.898675    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddea4336-870e-4c02-a7e4-288c10d5fbc2-bundle" (OuterVolumeSpecName: "bundle") pod "ddea4336-870e-4c02-a7e4-288c10d5fbc2" (UID: "ddea4336-870e-4c02-a7e4-288c10d5fbc2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:15:50.899996 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.899971    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-kube-api-access-6vjtn" (OuterVolumeSpecName: "kube-api-access-6vjtn") pod "7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" (UID: "7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4"). InnerVolumeSpecName "kube-api-access-6vjtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:15:50.900174 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.900160    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddea4336-870e-4c02-a7e4-288c10d5fbc2-kube-api-access-8bzff" (OuterVolumeSpecName: "kube-api-access-8bzff") pod "ddea4336-870e-4c02-a7e4-288c10d5fbc2" (UID: "ddea4336-870e-4c02-a7e4-288c10d5fbc2"). InnerVolumeSpecName "kube-api-access-8bzff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:15:50.903641 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.903616    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-util" (OuterVolumeSpecName: "util") pod "7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" (UID: "7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:15:50.904615 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.904594    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddea4336-870e-4c02-a7e4-288c10d5fbc2-util" (OuterVolumeSpecName: "util") pod "ddea4336-870e-4c02-a7e4-288c10d5fbc2" (UID: "ddea4336-870e-4c02-a7e4-288c10d5fbc2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:15:50.999280 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.999255    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-util\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:50.999280 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.999280    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bzff\" (UniqueName: \"kubernetes.io/projected/ddea4336-870e-4c02-a7e4-288c10d5fbc2-kube-api-access-8bzff\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:50.999431 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.999291    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vjtn\" (UniqueName: \"kubernetes.io/projected/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-kube-api-access-6vjtn\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:50.999431 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.999300    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddea4336-870e-4c02-a7e4-288c10d5fbc2-util\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:50.999431 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.999310    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddea4336-870e-4c02-a7e4-288c10d5fbc2-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:50.999431 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:50.999318    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:15:51.621479 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:51.621447    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm"
Jul 13 21:15:51.621891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:51.621442    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm" event={"ID":"7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4","Type":"ContainerDied","Data":"56f736f113fd354a6186f33ca430c93ba92a83b8ff9dc2616897cb0efa9bba67"}
Jul 13 21:15:51.621891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:51.621588    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56f736f113fd354a6186f33ca430c93ba92a83b8ff9dc2616897cb0efa9bba67"
Jul 13 21:15:51.623447 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:51.623429    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v"
Jul 13 21:15:51.623593 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:51.623422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v" event={"ID":"642421ee-dd9f-41c6-97d2-15566d3063a1","Type":"ContainerDied","Data":"dd054940fee559ca4ca32f62706c340945279a084cf71882796654a3beaadcf4"}
Jul 13 21:15:51.623593 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:51.623544    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd054940fee559ca4ca32f62706c340945279a084cf71882796654a3beaadcf4"
Jul 13 21:15:51.625352 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:51.625332    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq"
Jul 13 21:15:51.625482 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:51.625349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq" event={"ID":"ddea4336-870e-4c02-a7e4-288c10d5fbc2","Type":"ContainerDied","Data":"b4ec5bcf9c8584bbbb1c5b1585e2e54a7ef37d555114a68de2336a5b00b933e0"}
Jul 13 21:15:51.625482 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:15:51.625419    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4ec5bcf9c8584bbbb1c5b1585e2e54a7ef37d555114a68de2336a5b00b933e0"
Jul 13 21:16:01.838142 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838108    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b"]
Jul 13 21:16:01.838506 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838477    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" containerName="pull"
Jul 13 21:16:01.838506 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838487    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" containerName="pull"
Jul 13 21:16:01.838506 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838500    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642421ee-dd9f-41c6-97d2-15566d3063a1" containerName="util"
Jul 13 21:16:01.838506 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838505    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="642421ee-dd9f-41c6-97d2-15566d3063a1" containerName="util"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838511    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" containerName="extract"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838520    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" containerName="extract"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838529    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" containerName="pull"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838535    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" containerName="pull"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838545    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642421ee-dd9f-41c6-97d2-15566d3063a1" containerName="pull"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838550    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="642421ee-dd9f-41c6-97d2-15566d3063a1" containerName="pull"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838560    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddea4336-870e-4c02-a7e4-288c10d5fbc2" containerName="util"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838565    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddea4336-870e-4c02-a7e4-288c10d5fbc2" containerName="util"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838570    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" containerName="util"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838575    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" containerName="util"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838580    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddea4336-870e-4c02-a7e4-288c10d5fbc2" containerName="pull"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838585    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddea4336-870e-4c02-a7e4-288c10d5fbc2" containerName="pull"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838591    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642421ee-dd9f-41c6-97d2-15566d3063a1" containerName="extract"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838595    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="642421ee-dd9f-41c6-97d2-15566d3063a1" containerName="extract"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838601    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" containerName="extract"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838605    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" containerName="extract"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838611    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddea4336-870e-4c02-a7e4-288c10d5fbc2" containerName="extract"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838616    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddea4336-870e-4c02-a7e4-288c10d5fbc2" containerName="extract"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838622    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" containerName="util"
Jul 13 21:16:01.838640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838627    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" containerName="util"
Jul 13 21:16:01.839179 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838682    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddea4336-870e-4c02-a7e4-288c10d5fbc2" containerName="extract"
Jul 13 21:16:01.839179 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838690    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51" containerName="extract"
Jul 13 21:16:01.839179 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838697    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="642421ee-dd9f-41c6-97d2-15566d3063a1" containerName="extract"
Jul 13 21:16:01.839179 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.838706    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4" containerName="extract"
Jul 13 21:16:01.843175 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.843158    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b"
Jul 13 21:16:01.845533 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.845517    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-s86dt\""
Jul 13 21:16:01.855148 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.855125    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b"]
Jul 13 21:16:01.897909 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.897868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qjxl\" (UniqueName: \"kubernetes.io/projected/a792ce73-bf94-411d-b518-9e92821718a2-kube-api-access-6qjxl\") pod \"authorino-operator-75cc8d5cb7-wfb9b\" (UID: \"a792ce73-bf94-411d-b518-9e92821718a2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b"
Jul 13 21:16:01.999481 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:01.999447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qjxl\" (UniqueName: \"kubernetes.io/projected/a792ce73-bf94-411d-b518-9e92821718a2-kube-api-access-6qjxl\") pod \"authorino-operator-75cc8d5cb7-wfb9b\" (UID: \"a792ce73-bf94-411d-b518-9e92821718a2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b"
Jul 13 21:16:02.007661 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.007638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qjxl\" (UniqueName: \"kubernetes.io/projected/a792ce73-bf94-411d-b518-9e92821718a2-kube-api-access-6qjxl\") pod \"authorino-operator-75cc8d5cb7-wfb9b\" (UID: \"a792ce73-bf94-411d-b518-9e92821718a2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b"
Jul 13 21:16:02.154097 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.154070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b"
Jul 13 21:16:02.284142 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.284120    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b"]
Jul 13 21:16:02.286056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:16:02.286023    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda792ce73_bf94_411d_b518_9e92821718a2.slice/crio-d466ac9b5f435df1504d1164bd04937098c70faa5108e464ac839d68b910a815 WatchSource:0}: Error finding container d466ac9b5f435df1504d1164bd04937098c70faa5108e464ac839d68b910a815: Status 404 returned error can't find the container with id d466ac9b5f435df1504d1164bd04937098c70faa5108e464ac839d68b910a815
Jul 13 21:16:02.685180 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.685150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b" event={"ID":"a792ce73-bf94-411d-b518-9e92821718a2","Type":"ContainerStarted","Data":"d466ac9b5f435df1504d1164bd04937098c70faa5108e464ac839d68b910a815"}
Jul 13 21:16:02.784914 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.784883    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-96f4f569c-vsn6h"]
Jul 13 21:16:02.789601 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.789580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:02.803661 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.803626    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96f4f569c-vsn6h"]
Jul 13 21:16:02.908344 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.908310    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edcc4367-5003-46ba-9a82-169b9dc89e0a-oauth-serving-cert\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:02.908344 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.908357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edcc4367-5003-46ba-9a82-169b9dc89e0a-console-serving-cert\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:02.908778 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.908406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edcc4367-5003-46ba-9a82-169b9dc89e0a-trusted-ca-bundle\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:02.908778 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.908496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edcc4367-5003-46ba-9a82-169b9dc89e0a-console-oauth-config\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:02.908778 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.908531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edcc4367-5003-46ba-9a82-169b9dc89e0a-service-ca\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:02.908778 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.908557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gppq4\" (UniqueName: \"kubernetes.io/projected/edcc4367-5003-46ba-9a82-169b9dc89e0a-kube-api-access-gppq4\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:02.908778 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:02.908635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edcc4367-5003-46ba-9a82-169b9dc89e0a-console-config\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.009675 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.009596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edcc4367-5003-46ba-9a82-169b9dc89e0a-oauth-serving-cert\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.009675 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.009637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edcc4367-5003-46ba-9a82-169b9dc89e0a-console-serving-cert\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.009675 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.009658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edcc4367-5003-46ba-9a82-169b9dc89e0a-trusted-ca-bundle\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.009919 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.009700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edcc4367-5003-46ba-9a82-169b9dc89e0a-console-oauth-config\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.009919 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.009730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edcc4367-5003-46ba-9a82-169b9dc89e0a-service-ca\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.009919 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.009756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gppq4\" (UniqueName: \"kubernetes.io/projected/edcc4367-5003-46ba-9a82-169b9dc89e0a-kube-api-access-gppq4\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.009919 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.009814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edcc4367-5003-46ba-9a82-169b9dc89e0a-console-config\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.010488 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.010464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edcc4367-5003-46ba-9a82-169b9dc89e0a-service-ca\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.010612 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.010522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edcc4367-5003-46ba-9a82-169b9dc89e0a-oauth-serving-cert\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.010673 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.010657    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edcc4367-5003-46ba-9a82-169b9dc89e0a-console-config\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.010726 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.010663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edcc4367-5003-46ba-9a82-169b9dc89e0a-trusted-ca-bundle\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.012250 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.012224    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edcc4367-5003-46ba-9a82-169b9dc89e0a-console-serving-cert\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.012344 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.012268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edcc4367-5003-46ba-9a82-169b9dc89e0a-console-oauth-config\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.021623 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.021604    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gppq4\" (UniqueName: \"kubernetes.io/projected/edcc4367-5003-46ba-9a82-169b9dc89e0a-kube-api-access-gppq4\") pod \"console-96f4f569c-vsn6h\" (UID: \"edcc4367-5003-46ba-9a82-169b9dc89e0a\") " pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.098829 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.098803    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:03.282153 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.282113    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96f4f569c-vsn6h"]
Jul 13 21:16:03.282767 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:16:03.282737    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedcc4367_5003_46ba_9a82_169b9dc89e0a.slice/crio-cb314ca7f27746c496a391347285565ce98efae6f113714055648a4971331323 WatchSource:0}: Error finding container cb314ca7f27746c496a391347285565ce98efae6f113714055648a4971331323: Status 404 returned error can't find the container with id cb314ca7f27746c496a391347285565ce98efae6f113714055648a4971331323
Jul 13 21:16:03.693927 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.693890    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96f4f569c-vsn6h" event={"ID":"edcc4367-5003-46ba-9a82-169b9dc89e0a","Type":"ContainerStarted","Data":"2d4c3e3456178655ca85d08d6436b7062a5432879efc34d07484feef31efc729"}
Jul 13 21:16:03.694118 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.693987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96f4f569c-vsn6h" event={"ID":"edcc4367-5003-46ba-9a82-169b9dc89e0a","Type":"ContainerStarted","Data":"cb314ca7f27746c496a391347285565ce98efae6f113714055648a4971331323"}
Jul 13 21:16:03.720049 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:03.719979    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-96f4f569c-vsn6h" podStartSLOduration=1.71995791 podStartE2EDuration="1.71995791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:03.71730761 +0000 UTC m=+407.572452494" watchObservedRunningTime="2026-07-13 21:16:03.71995791 +0000 UTC m=+407.575102793"
Jul 13 21:16:05.624845 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:05.624813    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk"]
Jul 13 21:16:05.628354 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:05.628334    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk"
Jul 13 21:16:05.630843 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:05.630820    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 13 21:16:05.630954 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:05.630934    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jsvwp\""
Jul 13 21:16:05.643629 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:05.643605    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk"]
Jul 13 21:16:05.710399 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:05.710349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b" event={"ID":"a792ce73-bf94-411d-b518-9e92821718a2","Type":"ContainerStarted","Data":"0d2cfd30d78e0ae57304d10cb662c84c9b6d9e8dc425672c019e524b9c7800d6"}
Jul 13 21:16:05.710559 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:05.710503    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b"
Jul 13 21:16:05.725890 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:05.725844    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b" podStartSLOduration=2.262543109 podStartE2EDuration="4.72583078s" totalImagesPullingTime="2.463287671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:05.724937542 +0000 UTC m=+409.580082426" watchObservedRunningTime="2026-07-13 21:16:05.72583078 +0000 UTC m=+409.580975661"
Jul 13 21:16:05.738439 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:05.738409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhb4k\" (UniqueName: \"kubernetes.io/projected/f1ff6884-a46d-4504-bacf-7e07148572c7-kube-api-access-zhb4k\") pod \"dns-operator-controller-manager-864dd78c4c-csbrk\" (UID: \"f1ff6884-a46d-4504-bacf-7e07148572c7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk"
Jul 13 21:16:05.839341 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:05.839307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhb4k\" (UniqueName: \"kubernetes.io/projected/f1ff6884-a46d-4504-bacf-7e07148572c7-kube-api-access-zhb4k\") pod \"dns-operator-controller-manager-864dd78c4c-csbrk\" (UID: \"f1ff6884-a46d-4504-bacf-7e07148572c7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk"
Jul 13 21:16:05.847585 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:05.847554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhb4k\" (UniqueName: \"kubernetes.io/projected/f1ff6884-a46d-4504-bacf-7e07148572c7-kube-api-access-zhb4k\") pod \"dns-operator-controller-manager-864dd78c4c-csbrk\" (UID: \"f1ff6884-a46d-4504-bacf-7e07148572c7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk"
Jul 13 21:16:05.939031 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:05.939004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk"
Jul 13 21:16:06.075375 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:06.075348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk"]
Jul 13 21:16:06.077093 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:16:06.077065    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ff6884_a46d_4504_bacf_7e07148572c7.slice/crio-4359d3f89f5690030af63db0e78d8113a6fa6e46c09ef2bdf2847b90926b5f1a WatchSource:0}: Error finding container 4359d3f89f5690030af63db0e78d8113a6fa6e46c09ef2bdf2847b90926b5f1a: Status 404 returned error can't find the container with id 4359d3f89f5690030af63db0e78d8113a6fa6e46c09ef2bdf2847b90926b5f1a
Jul 13 21:16:06.717924 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:06.717892    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk" event={"ID":"f1ff6884-a46d-4504-bacf-7e07148572c7","Type":"ContainerStarted","Data":"4359d3f89f5690030af63db0e78d8113a6fa6e46c09ef2bdf2847b90926b5f1a"}
Jul 13 21:16:08.733409 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:08.733346    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk" event={"ID":"f1ff6884-a46d-4504-bacf-7e07148572c7","Type":"ContainerStarted","Data":"ec72e5cfab86659e3d0ad3fd6c8f0fce62bf8caed053a0f99deab2e1fac41e60"}
Jul 13 21:16:08.733802 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:08.733499    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk"
Jul 13 21:16:08.747867 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:08.747840    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"]
Jul 13 21:16:08.751484 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:08.751466    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:08.753489 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:08.753468    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kdqxh\""
Jul 13 21:16:08.756802 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:08.756759    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk" podStartSLOduration=1.552949312 podStartE2EDuration="3.756744943s" totalImagesPullingTime="2.203795631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:08.755829129 +0000 UTC m=+412.610974015" watchObservedRunningTime="2026-07-13 21:16:08.756744943 +0000 UTC m=+412.611889837"
Jul 13 21:16:08.761973 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:08.761948    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"]
Jul 13 21:16:08.873904 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:08.873605    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc7t2\" (UniqueName: \"kubernetes.io/projected/7bc4eadd-d086-4a4d-bf35-66b8b3e4069b-kube-api-access-gc7t2\") pod \"limitador-operator-controller-manager-859d7b78bd-9kvds\" (UID: \"7bc4eadd-d086-4a4d-bf35-66b8b3e4069b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:08.975054 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:08.975023    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc7t2\" (UniqueName: \"kubernetes.io/projected/7bc4eadd-d086-4a4d-bf35-66b8b3e4069b-kube-api-access-gc7t2\") pod \"limitador-operator-controller-manager-859d7b78bd-9kvds\" (UID: \"7bc4eadd-d086-4a4d-bf35-66b8b3e4069b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:08.984010 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:08.983941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc7t2\" (UniqueName: \"kubernetes.io/projected/7bc4eadd-d086-4a4d-bf35-66b8b3e4069b-kube-api-access-gc7t2\") pod \"limitador-operator-controller-manager-859d7b78bd-9kvds\" (UID: \"7bc4eadd-d086-4a4d-bf35-66b8b3e4069b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:09.063520 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:09.063493    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:09.204328 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:09.204303    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"]
Jul 13 21:16:09.205946 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:16:09.205918    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc4eadd_d086_4a4d_bf35_66b8b3e4069b.slice/crio-848a8220cd865ab890102a326f9503f0ce58eff552fbed9f0bbb85a30dfcdb20 WatchSource:0}: Error finding container 848a8220cd865ab890102a326f9503f0ce58eff552fbed9f0bbb85a30dfcdb20: Status 404 returned error can't find the container with id 848a8220cd865ab890102a326f9503f0ce58eff552fbed9f0bbb85a30dfcdb20
Jul 13 21:16:09.741615 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:09.741585    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds" event={"ID":"7bc4eadd-d086-4a4d-bf35-66b8b3e4069b","Type":"ContainerStarted","Data":"848a8220cd865ab890102a326f9503f0ce58eff552fbed9f0bbb85a30dfcdb20"}
Jul 13 21:16:11.753640 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:11.753550    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds" event={"ID":"7bc4eadd-d086-4a4d-bf35-66b8b3e4069b","Type":"ContainerStarted","Data":"eb954298a102cd8e2e3e2ec4b48c58cc134f0ff033f22901bff528744c5a5ddd"}
Jul 13 21:16:11.754071 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:11.753648    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:11.773333 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:11.773284    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds" podStartSLOduration=1.512040686 podStartE2EDuration="3.773267385s" totalImagesPullingTime="2.261226699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:11.772899826 +0000 UTC m=+415.628044708" watchObservedRunningTime="2026-07-13 21:16:11.773267385 +0000 UTC m=+415.628412267"
Jul 13 21:16:13.099483 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.099449    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:13.099871 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.099503    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:13.104504 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.104479    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:13.250494 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.250460    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"]
Jul 13 21:16:13.254351 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.254328    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:13.258177 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.258160    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w5gbw\""
Jul 13 21:16:13.271042 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.271009    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"]
Jul 13 21:16:13.415583 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.415557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jxbq\" (UniqueName: \"kubernetes.io/projected/b5916f08-c8b7-45a1-8951-17da45f6ddd8-kube-api-access-9jxbq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" (UID: \"b5916f08-c8b7-45a1-8951-17da45f6ddd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:13.415717 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.415604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5916f08-c8b7-45a1-8951-17da45f6ddd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" (UID: \"b5916f08-c8b7-45a1-8951-17da45f6ddd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:13.516418 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.516371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jxbq\" (UniqueName: \"kubernetes.io/projected/b5916f08-c8b7-45a1-8951-17da45f6ddd8-kube-api-access-9jxbq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" (UID: \"b5916f08-c8b7-45a1-8951-17da45f6ddd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:13.516552 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.516442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5916f08-c8b7-45a1-8951-17da45f6ddd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" (UID: \"b5916f08-c8b7-45a1-8951-17da45f6ddd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:13.516780 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.516765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5916f08-c8b7-45a1-8951-17da45f6ddd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" (UID: \"b5916f08-c8b7-45a1-8951-17da45f6ddd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:13.524655 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.524633    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jxbq\" (UniqueName: \"kubernetes.io/projected/b5916f08-c8b7-45a1-8951-17da45f6ddd8-kube-api-access-9jxbq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" (UID: \"b5916f08-c8b7-45a1-8951-17da45f6ddd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:13.564750 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.564730    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:13.698749 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.698716    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"]
Jul 13 21:16:13.700509 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:16:13.700482    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5916f08_c8b7_45a1_8951_17da45f6ddd8.slice/crio-347ecf87b6eef2f611dcd1ee7d3c7d6b9df402787e21202a3a4e06386398b094 WatchSource:0}: Error finding container 347ecf87b6eef2f611dcd1ee7d3c7d6b9df402787e21202a3a4e06386398b094: Status 404 returned error can't find the container with id 347ecf87b6eef2f611dcd1ee7d3c7d6b9df402787e21202a3a4e06386398b094
Jul 13 21:16:13.765215 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.765185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s" event={"ID":"b5916f08-c8b7-45a1-8951-17da45f6ddd8","Type":"ContainerStarted","Data":"347ecf87b6eef2f611dcd1ee7d3c7d6b9df402787e21202a3a4e06386398b094"}
Jul 13 21:16:13.769089 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.769069    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-96f4f569c-vsn6h"
Jul 13 21:16:13.816424 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:13.816374    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7999d85f49-f2fgr"]
Jul 13 21:16:16.728326 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:16.728293    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wfb9b"
Jul 13 21:16:19.745001 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:19.744964    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-csbrk"
Jul 13 21:16:20.811091 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:20.811061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s" event={"ID":"b5916f08-c8b7-45a1-8951-17da45f6ddd8","Type":"ContainerStarted","Data":"cf948c4785de9688c0c724aaeb2d17ef4f4593ff47a417102ebfab64be62fbef"}
Jul 13 21:16:20.811553 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:20.811133    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:20.833939 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:20.833888    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s" podStartSLOduration=1.38212059 podStartE2EDuration="7.833872019s" totalImagesPullingTime="6.451751429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:20.830804832 +0000 UTC m=+424.685949713" watchObservedRunningTime="2026-07-13 21:16:20.833872019 +0000 UTC m=+424.689016901"
Jul 13 21:16:22.761087 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:22.761057    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:31.819507 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:31.819475    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.447641 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.447601    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"]
Jul 13 21:16:33.448062 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.447792    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" containerName="manager" containerID="cri-o://cf948c4785de9688c0c724aaeb2d17ef4f4593ff47a417102ebfab64be62fbef" gracePeriod=2
Jul 13 21:16:33.455702 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.455673    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"]
Jul 13 21:16:33.457249 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.456949    2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b5916f08-c8b7-45a1-8951-17da45f6ddd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-87v7s\": pods \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.471321 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.471291    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"]
Jul 13 21:16:33.471618 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.471555    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" containerName="manager" containerID="cri-o://eb954298a102cd8e2e3e2ec4b48c58cc134f0ff033f22901bff528744c5a5ddd" gracePeriod=2
Jul 13 21:16:33.473634 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.473525    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.480362 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.480328    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"]
Jul 13 21:16:33.480974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.480945    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" containerName="manager"
Jul 13 21:16:33.480974 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.480966    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" containerName="manager"
Jul 13 21:16:33.481131 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.481095    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" containerName="manager"
Jul 13 21:16:33.484791 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.484743    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"]
Jul 13 21:16:33.484888 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.484875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"
Jul 13 21:16:33.493271 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.493236    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kvds\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:33.507711 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.507679    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"]
Jul 13 21:16:33.510000 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.509974    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2"]
Jul 13 21:16:33.510400 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.510370    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" containerName="manager"
Jul 13 21:16:33.510400 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.510401    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" containerName="manager"
Jul 13 21:16:33.510570 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.510476    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" containerName="manager"
Jul 13 21:16:33.513514 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.513498    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2"
Jul 13 21:16:33.523299 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.523273    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2"]
Jul 13 21:16:33.523893 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.523863    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.525539 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.525517    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.531953 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.531929    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kvds\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:33.596358 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.596330    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnqp7\" (UniqueName: \"kubernetes.io/projected/e8b2508c-4964-4b6f-a53e-f24a95382549-kube-api-access-nnqp7\") pod \"limitador-operator-controller-manager-859d7b78bd-lqjp2\" (UID: \"e8b2508c-4964-4b6f-a53e-f24a95382549\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2"
Jul 13 21:16:33.596506 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.596430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6crld\" (UniqueName: \"kubernetes.io/projected/29d480d6-b146-4656-91a7-1bb8c5702c44-kube-api-access-6crld\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xz4x6\" (UID: \"29d480d6-b146-4656-91a7-1bb8c5702c44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"
Jul 13 21:16:33.596572 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.596507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29d480d6-b146-4656-91a7-1bb8c5702c44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xz4x6\" (UID: \"29d480d6-b146-4656-91a7-1bb8c5702c44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"
Jul 13 21:16:33.697187 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.697155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6crld\" (UniqueName: \"kubernetes.io/projected/29d480d6-b146-4656-91a7-1bb8c5702c44-kube-api-access-6crld\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xz4x6\" (UID: \"29d480d6-b146-4656-91a7-1bb8c5702c44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"
Jul 13 21:16:33.697328 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.697239    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29d480d6-b146-4656-91a7-1bb8c5702c44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xz4x6\" (UID: \"29d480d6-b146-4656-91a7-1bb8c5702c44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"
Jul 13 21:16:33.697328 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.697300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnqp7\" (UniqueName: \"kubernetes.io/projected/e8b2508c-4964-4b6f-a53e-f24a95382549-kube-api-access-nnqp7\") pod \"limitador-operator-controller-manager-859d7b78bd-lqjp2\" (UID: \"e8b2508c-4964-4b6f-a53e-f24a95382549\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2"
Jul 13 21:16:33.697743 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.697688    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29d480d6-b146-4656-91a7-1bb8c5702c44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xz4x6\" (UID: \"29d480d6-b146-4656-91a7-1bb8c5702c44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"
Jul 13 21:16:33.706289 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.706262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnqp7\" (UniqueName: \"kubernetes.io/projected/e8b2508c-4964-4b6f-a53e-f24a95382549-kube-api-access-nnqp7\") pod \"limitador-operator-controller-manager-859d7b78bd-lqjp2\" (UID: \"e8b2508c-4964-4b6f-a53e-f24a95382549\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2"
Jul 13 21:16:33.706448 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.706274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6crld\" (UniqueName: \"kubernetes.io/projected/29d480d6-b146-4656-91a7-1bb8c5702c44-kube-api-access-6crld\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xz4x6\" (UID: \"29d480d6-b146-4656-91a7-1bb8c5702c44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"
Jul 13 21:16:33.724878 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.724854    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.727010 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.726977    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.727231 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.727214    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:33.728480 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.728461    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kvds\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:33.729821 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.729798    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.731294 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.731276    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kvds\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:33.798223 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.798190    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jxbq\" (UniqueName: \"kubernetes.io/projected/b5916f08-c8b7-45a1-8951-17da45f6ddd8-kube-api-access-9jxbq\") pod \"b5916f08-c8b7-45a1-8951-17da45f6ddd8\" (UID: \"b5916f08-c8b7-45a1-8951-17da45f6ddd8\") "
Jul 13 21:16:33.798365 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.798238    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5916f08-c8b7-45a1-8951-17da45f6ddd8-extensions-socket-volume\") pod \"b5916f08-c8b7-45a1-8951-17da45f6ddd8\" (UID: \"b5916f08-c8b7-45a1-8951-17da45f6ddd8\") "
Jul 13 21:16:33.798365 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.798264    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc7t2\" (UniqueName: \"kubernetes.io/projected/7bc4eadd-d086-4a4d-bf35-66b8b3e4069b-kube-api-access-gc7t2\") pod \"7bc4eadd-d086-4a4d-bf35-66b8b3e4069b\" (UID: \"7bc4eadd-d086-4a4d-bf35-66b8b3e4069b\") "
Jul 13 21:16:33.798763 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.798739    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5916f08-c8b7-45a1-8951-17da45f6ddd8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b5916f08-c8b7-45a1-8951-17da45f6ddd8" (UID: "b5916f08-c8b7-45a1-8951-17da45f6ddd8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:16:33.800297 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.800274    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5916f08-c8b7-45a1-8951-17da45f6ddd8-kube-api-access-9jxbq" (OuterVolumeSpecName: "kube-api-access-9jxbq") pod "b5916f08-c8b7-45a1-8951-17da45f6ddd8" (UID: "b5916f08-c8b7-45a1-8951-17da45f6ddd8"). InnerVolumeSpecName "kube-api-access-9jxbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:16:33.800407 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.800316    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bc4eadd-d086-4a4d-bf35-66b8b3e4069b-kube-api-access-gc7t2" (OuterVolumeSpecName: "kube-api-access-gc7t2") pod "7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" (UID: "7bc4eadd-d086-4a4d-bf35-66b8b3e4069b"). InnerVolumeSpecName "kube-api-access-gc7t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:16:33.884201 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.884166    2580 generic.go:356] "Generic (PLEG): container finished" podID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" containerID="cf948c4785de9688c0c724aaeb2d17ef4f4593ff47a417102ebfab64be62fbef" exitCode=0
Jul 13 21:16:33.884396 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.884213    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.884396 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.884265    2580 scope.go:117] "RemoveContainer" containerID="cf948c4785de9688c0c724aaeb2d17ef4f4593ff47a417102ebfab64be62fbef"
Jul 13 21:16:33.892259 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.886481    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.892259 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.888079    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kvds\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:33.893090 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.893059    2580 generic.go:356] "Generic (PLEG): container finished" podID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" containerID="eb954298a102cd8e2e3e2ec4b48c58cc134f0ff033f22901bff528744c5a5ddd" exitCode=0
Jul 13 21:16:33.893226 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.893121    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:33.895119 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.895046    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.896664 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.896638    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kvds\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:33.898790 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.898761    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.899047 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.899025    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jxbq\" (UniqueName: \"kubernetes.io/projected/b5916f08-c8b7-45a1-8951-17da45f6ddd8-kube-api-access-9jxbq\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:16:33.899099 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.899055    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5916f08-c8b7-45a1-8951-17da45f6ddd8-extensions-socket-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:16:33.899099 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.899072    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc7t2\" (UniqueName: \"kubernetes.io/projected/7bc4eadd-d086-4a4d-bf35-66b8b3e4069b-kube-api-access-gc7t2\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:16:33.900175 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.900149    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kvds\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:33.902047 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.902020    2580 scope.go:117] "RemoveContainer" containerID="cf948c4785de9688c0c724aaeb2d17ef4f4593ff47a417102ebfab64be62fbef"
Jul 13 21:16:33.902308 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.902289    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf948c4785de9688c0c724aaeb2d17ef4f4593ff47a417102ebfab64be62fbef\": container with ID starting with cf948c4785de9688c0c724aaeb2d17ef4f4593ff47a417102ebfab64be62fbef not found: ID does not exist" containerID="cf948c4785de9688c0c724aaeb2d17ef4f4593ff47a417102ebfab64be62fbef"
Jul 13 21:16:33.902368 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.902316    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf948c4785de9688c0c724aaeb2d17ef4f4593ff47a417102ebfab64be62fbef"} err="failed to get container status \"cf948c4785de9688c0c724aaeb2d17ef4f4593ff47a417102ebfab64be62fbef\": rpc error: code = NotFound desc = could not find container \"cf948c4785de9688c0c724aaeb2d17ef4f4593ff47a417102ebfab64be62fbef\": container with ID starting with cf948c4785de9688c0c724aaeb2d17ef4f4593ff47a417102ebfab64be62fbef not found: ID does not exist"
Jul 13 21:16:33.902368 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.902332    2580 scope.go:117] "RemoveContainer" containerID="eb954298a102cd8e2e3e2ec4b48c58cc134f0ff033f22901bff528744c5a5ddd"
Jul 13 21:16:33.903515 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.903488    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-87v7s\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-87v7s"
Jul 13 21:16:33.904957 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.904932    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kvds\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kvds"
Jul 13 21:16:33.912813 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.912796    2580 scope.go:117] "RemoveContainer" containerID="eb954298a102cd8e2e3e2ec4b48c58cc134f0ff033f22901bff528744c5a5ddd"
Jul 13 21:16:33.913055 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:33.913037    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb954298a102cd8e2e3e2ec4b48c58cc134f0ff033f22901bff528744c5a5ddd\": container with ID starting with eb954298a102cd8e2e3e2ec4b48c58cc134f0ff033f22901bff528744c5a5ddd not found: ID does not exist" containerID="eb954298a102cd8e2e3e2ec4b48c58cc134f0ff033f22901bff528744c5a5ddd"
Jul 13 21:16:33.913156 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.913060    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb954298a102cd8e2e3e2ec4b48c58cc134f0ff033f22901bff528744c5a5ddd"} err="failed to get container status \"eb954298a102cd8e2e3e2ec4b48c58cc134f0ff033f22901bff528744c5a5ddd\": rpc error: code = NotFound desc = could not find container \"eb954298a102cd8e2e3e2ec4b48c58cc134f0ff033f22901bff528744c5a5ddd\": container with ID starting with eb954298a102cd8e2e3e2ec4b48c58cc134f0ff033f22901bff528744c5a5ddd not found: ID does not exist"
Jul 13 21:16:33.916251 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.916233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"
Jul 13 21:16:33.923006 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:33.922968    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2"
Jul 13 21:16:34.064182 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:34.064152    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"]
Jul 13 21:16:34.065183 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:16:34.065153    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d480d6_b146_4656_91a7_1bb8c5702c44.slice/crio-40bd9a09030e400ef6a89743cb62e871d0c995bb011ce77b96944c43a28c301f WatchSource:0}: Error finding container 40bd9a09030e400ef6a89743cb62e871d0c995bb011ce77b96944c43a28c301f: Status 404 returned error can't find the container with id 40bd9a09030e400ef6a89743cb62e871d0c995bb011ce77b96944c43a28c301f
Jul 13 21:16:34.089485 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:34.089461    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2"]
Jul 13 21:16:34.090914 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:16:34.090893    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b2508c_4964_4b6f_a53e_f24a95382549.slice/crio-d8e2ab27ac81b55f1fb90165d3d74b6ac552c5d452d82aa76b63b2c78212d96c WatchSource:0}: Error finding container d8e2ab27ac81b55f1fb90165d3d74b6ac552c5d452d82aa76b63b2c78212d96c: Status 404 returned error can't find the container with id d8e2ab27ac81b55f1fb90165d3d74b6ac552c5d452d82aa76b63b2c78212d96c
Jul 13 21:16:34.715639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:34.715608    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bc4eadd-d086-4a4d-bf35-66b8b3e4069b" path="/var/lib/kubelet/pods/7bc4eadd-d086-4a4d-bf35-66b8b3e4069b/volumes"
Jul 13 21:16:34.716026 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:34.716012    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5916f08-c8b7-45a1-8951-17da45f6ddd8" path="/var/lib/kubelet/pods/b5916f08-c8b7-45a1-8951-17da45f6ddd8/volumes"
Jul 13 21:16:34.902462 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:34.902426    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2" event={"ID":"e8b2508c-4964-4b6f-a53e-f24a95382549","Type":"ContainerStarted","Data":"07dd91ec33c05750ef7f8bf4b699241e9e8cdadb117980064b3f626abc5c41cf"}
Jul 13 21:16:34.902764 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:34.902725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2" event={"ID":"e8b2508c-4964-4b6f-a53e-f24a95382549","Type":"ContainerStarted","Data":"d8e2ab27ac81b55f1fb90165d3d74b6ac552c5d452d82aa76b63b2c78212d96c"}
Jul 13 21:16:34.902872 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:34.902792    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2"
Jul 13 21:16:34.904995 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:34.904966    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6" event={"ID":"29d480d6-b146-4656-91a7-1bb8c5702c44","Type":"ContainerStarted","Data":"681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959"}
Jul 13 21:16:34.905207 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:34.905180    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"
Jul 13 21:16:34.905339 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:34.905214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6" event={"ID":"29d480d6-b146-4656-91a7-1bb8c5702c44","Type":"ContainerStarted","Data":"40bd9a09030e400ef6a89743cb62e871d0c995bb011ce77b96944c43a28c301f"}
Jul 13 21:16:34.947716 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:34.947663    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2" podStartSLOduration=1.947647087 podStartE2EDuration="1.947647087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:34.944107295 +0000 UTC m=+438.799252187" watchObservedRunningTime="2026-07-13 21:16:34.947647087 +0000 UTC m=+438.802791969"
Jul 13 21:16:34.970390 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:34.970339    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6" podStartSLOduration=1.970321673 podStartE2EDuration="1.970321673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:34.969819092 +0000 UTC m=+438.824963976" watchObservedRunningTime="2026-07-13 21:16:34.970321673 +0000 UTC m=+438.825466554"
Jul 13 21:16:38.839201 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:38.839081    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7999d85f49-f2fgr" podUID="e5dbad58-ce9e-4189-8e44-5913ec3c7a59" containerName="console" containerID="cri-o://3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2" gracePeriod=15
Jul 13 21:16:39.094592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.094534    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:16:39.144558 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.144523    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq4tz\" (UniqueName: \"kubernetes.io/projected/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-kube-api-access-mq4tz\") pod \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") "
Jul 13 21:16:39.144737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.144572    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-trusted-ca-bundle\") pod \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") "
Jul 13 21:16:39.144737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.144623    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-config\") pod \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") "
Jul 13 21:16:39.144737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.144649    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-service-ca\") pod \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") "
Jul 13 21:16:39.144737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.144684    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-oauth-config\") pod \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") "
Jul 13 21:16:39.144737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.144706    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-serving-cert\") pod \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") "
Jul 13 21:16:39.145024 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.144746    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-oauth-serving-cert\") pod \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\" (UID: \"e5dbad58-ce9e-4189-8e44-5913ec3c7a59\") "
Jul 13 21:16:39.145083 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.145025    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-config" (OuterVolumeSpecName: "console-config") pod "e5dbad58-ce9e-4189-8e44-5913ec3c7a59" (UID: "e5dbad58-ce9e-4189-8e44-5913ec3c7a59"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:16:39.145215 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.145189    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e5dbad58-ce9e-4189-8e44-5913ec3c7a59" (UID: "e5dbad58-ce9e-4189-8e44-5913ec3c7a59"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:16:39.145420 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.145371    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-service-ca" (OuterVolumeSpecName: "service-ca") pod "e5dbad58-ce9e-4189-8e44-5913ec3c7a59" (UID: "e5dbad58-ce9e-4189-8e44-5913ec3c7a59"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:16:39.145420 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.145367    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e5dbad58-ce9e-4189-8e44-5913ec3c7a59" (UID: "e5dbad58-ce9e-4189-8e44-5913ec3c7a59"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:16:39.146814 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.146789    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-kube-api-access-mq4tz" (OuterVolumeSpecName: "kube-api-access-mq4tz") pod "e5dbad58-ce9e-4189-8e44-5913ec3c7a59" (UID: "e5dbad58-ce9e-4189-8e44-5913ec3c7a59"). InnerVolumeSpecName "kube-api-access-mq4tz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:16:39.146940 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.146899    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e5dbad58-ce9e-4189-8e44-5913ec3c7a59" (UID: "e5dbad58-ce9e-4189-8e44-5913ec3c7a59"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:16:39.147012 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.146978    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e5dbad58-ce9e-4189-8e44-5913ec3c7a59" (UID: "e5dbad58-ce9e-4189-8e44-5913ec3c7a59"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:16:39.246438 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.246408    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-oauth-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:16:39.246438 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.246434    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-serving-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:16:39.246438 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.246444    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-oauth-serving-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:16:39.246655 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.246452    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq4tz\" (UniqueName: \"kubernetes.io/projected/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-kube-api-access-mq4tz\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:16:39.246655 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.246461    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-trusted-ca-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:16:39.246655 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.246470    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-console-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:16:39.246655 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.246479    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5dbad58-ce9e-4189-8e44-5913ec3c7a59-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:16:39.933715 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.933680    2580 generic.go:356] "Generic (PLEG): container finished" podID="e5dbad58-ce9e-4189-8e44-5913ec3c7a59" containerID="3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2" exitCode=0
Jul 13 21:16:39.934152 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.933726    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7999d85f49-f2fgr"
Jul 13 21:16:39.934152 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.933744    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7999d85f49-f2fgr" event={"ID":"e5dbad58-ce9e-4189-8e44-5913ec3c7a59","Type":"ContainerDied","Data":"3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2"}
Jul 13 21:16:39.934152 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.933798    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7999d85f49-f2fgr" event={"ID":"e5dbad58-ce9e-4189-8e44-5913ec3c7a59","Type":"ContainerDied","Data":"2959d82bbc7343f316004be806181cf795b14e2f8eea4929e2cd049a17f6a1fd"}
Jul 13 21:16:39.934152 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.933819    2580 scope.go:117] "RemoveContainer" containerID="3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2"
Jul 13 21:16:39.943831 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.943813    2580 scope.go:117] "RemoveContainer" containerID="3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2"
Jul 13 21:16:39.944099 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:16:39.944077    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2\": container with ID starting with 3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2 not found: ID does not exist" containerID="3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2"
Jul 13 21:16:39.944151 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.944107    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2"} err="failed to get container status \"3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2\": rpc error: code = NotFound desc = could not find container \"3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2\": container with ID starting with 3e46046042c6571a56183bc3378fedbca0dfa1f96df3dcc3d30f970c02d1f2f2 not found: ID does not exist"
Jul 13 21:16:39.957407 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.957368    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7999d85f49-f2fgr"]
Jul 13 21:16:39.961159 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:39.961140    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7999d85f49-f2fgr"]
Jul 13 21:16:40.718956 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:40.718923    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5dbad58-ce9e-4189-8e44-5913ec3c7a59" path="/var/lib/kubelet/pods/e5dbad58-ce9e-4189-8e44-5913ec3c7a59/volumes"
Jul 13 21:16:45.913149 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:45.913119    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"
Jul 13 21:16:45.913535 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:16:45.913187    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqjp2"
Jul 13 21:17:04.518692 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.518660    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"]
Jul 13 21:17:04.519107 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.518887    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6" podUID="29d480d6-b146-4656-91a7-1bb8c5702c44" containerName="manager" containerID="cri-o://681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959" gracePeriod=10
Jul 13 21:17:04.738821 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.738780    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"]
Jul 13 21:17:04.739425 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.739408    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5dbad58-ce9e-4189-8e44-5913ec3c7a59" containerName="console"
Jul 13 21:17:04.739484 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.739428    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5dbad58-ce9e-4189-8e44-5913ec3c7a59" containerName="console"
Jul 13 21:17:04.739556 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.739545    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5dbad58-ce9e-4189-8e44-5913ec3c7a59" containerName="console"
Jul 13 21:17:04.742066 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.742048    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"
Jul 13 21:17:04.761792 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.761765    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"]
Jul 13 21:17:04.778767 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.778712    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"
Jul 13 21:17:04.881955 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.881924    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29d480d6-b146-4656-91a7-1bb8c5702c44-extensions-socket-volume\") pod \"29d480d6-b146-4656-91a7-1bb8c5702c44\" (UID: \"29d480d6-b146-4656-91a7-1bb8c5702c44\") "
Jul 13 21:17:04.882132 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.881989    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6crld\" (UniqueName: \"kubernetes.io/projected/29d480d6-b146-4656-91a7-1bb8c5702c44-kube-api-access-6crld\") pod \"29d480d6-b146-4656-91a7-1bb8c5702c44\" (UID: \"29d480d6-b146-4656-91a7-1bb8c5702c44\") "
Jul 13 21:17:04.882285 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.882263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/005c8680-e814-4c69-8924-424a61823413-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tzrt8\" (UID: \"005c8680-e814-4c69-8924-424a61823413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"
Jul 13 21:17:04.882341 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.882323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvlw6\" (UniqueName: \"kubernetes.io/projected/005c8680-e814-4c69-8924-424a61823413-kube-api-access-lvlw6\") pod \"kuadrant-operator-controller-manager-86878c769f-tzrt8\" (UID: \"005c8680-e814-4c69-8924-424a61823413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"
Jul 13 21:17:04.882467 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.882428    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29d480d6-b146-4656-91a7-1bb8c5702c44-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "29d480d6-b146-4656-91a7-1bb8c5702c44" (UID: "29d480d6-b146-4656-91a7-1bb8c5702c44"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:17:04.882508 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.882486    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29d480d6-b146-4656-91a7-1bb8c5702c44-extensions-socket-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:17:04.884096 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.884070    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29d480d6-b146-4656-91a7-1bb8c5702c44-kube-api-access-6crld" (OuterVolumeSpecName: "kube-api-access-6crld") pod "29d480d6-b146-4656-91a7-1bb8c5702c44" (UID: "29d480d6-b146-4656-91a7-1bb8c5702c44"). InnerVolumeSpecName "kube-api-access-6crld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:17:04.983167 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.983132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/005c8680-e814-4c69-8924-424a61823413-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tzrt8\" (UID: \"005c8680-e814-4c69-8924-424a61823413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"
Jul 13 21:17:04.983331 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.983177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvlw6\" (UniqueName: \"kubernetes.io/projected/005c8680-e814-4c69-8924-424a61823413-kube-api-access-lvlw6\") pod \"kuadrant-operator-controller-manager-86878c769f-tzrt8\" (UID: \"005c8680-e814-4c69-8924-424a61823413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"
Jul 13 21:17:04.983331 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.983260    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6crld\" (UniqueName: \"kubernetes.io/projected/29d480d6-b146-4656-91a7-1bb8c5702c44-kube-api-access-6crld\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:17:04.983540 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.983519    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/005c8680-e814-4c69-8924-424a61823413-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tzrt8\" (UID: \"005c8680-e814-4c69-8924-424a61823413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"
Jul 13 21:17:04.992055 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:04.992029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvlw6\" (UniqueName: \"kubernetes.io/projected/005c8680-e814-4c69-8924-424a61823413-kube-api-access-lvlw6\") pod \"kuadrant-operator-controller-manager-86878c769f-tzrt8\" (UID: \"005c8680-e814-4c69-8924-424a61823413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"
Jul 13 21:17:05.053197 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:05.053119    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"
Jul 13 21:17:05.083040 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:05.083006    2580 generic.go:356] "Generic (PLEG): container finished" podID="29d480d6-b146-4656-91a7-1bb8c5702c44" containerID="681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959" exitCode=0
Jul 13 21:17:05.083190 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:05.083058    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"
Jul 13 21:17:05.083190 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:05.083055    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6" event={"ID":"29d480d6-b146-4656-91a7-1bb8c5702c44","Type":"ContainerDied","Data":"681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959"}
Jul 13 21:17:05.083190 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:05.083176    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6" event={"ID":"29d480d6-b146-4656-91a7-1bb8c5702c44","Type":"ContainerDied","Data":"40bd9a09030e400ef6a89743cb62e871d0c995bb011ce77b96944c43a28c301f"}
Jul 13 21:17:05.083323 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:05.083199    2580 scope.go:117] "RemoveContainer" containerID="681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959"
Jul 13 21:17:05.092854 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:05.092836    2580 scope.go:117] "RemoveContainer" containerID="681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959"
Jul 13 21:17:05.093118 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:17:05.093103    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959\": container with ID starting with 681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959 not found: ID does not exist" containerID="681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959"
Jul 13 21:17:05.093164 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:05.093126    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959"} err="failed to get container status \"681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959\": rpc error: code = NotFound desc = could not find container \"681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959\": container with ID starting with 681bea2def81ef623060085b351cb1db6cda5a131863d4cb7895dfacaa239959 not found: ID does not exist"
Jul 13 21:17:05.105459 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:05.105434    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"]
Jul 13 21:17:05.112917 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:05.112886    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4x6"]
Jul 13 21:17:05.195746 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:05.195693    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"]
Jul 13 21:17:05.198427 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:17:05.198373    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005c8680_e814_4c69_8924_424a61823413.slice/crio-0eb479ce807ba9458b8468d70f2898ff29ffcddfe53698e6062e32f26fef5625 WatchSource:0}: Error finding container 0eb479ce807ba9458b8468d70f2898ff29ffcddfe53698e6062e32f26fef5625: Status 404 returned error can't find the container with id 0eb479ce807ba9458b8468d70f2898ff29ffcddfe53698e6062e32f26fef5625
Jul 13 21:17:06.092116 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:06.092075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8" event={"ID":"005c8680-e814-4c69-8924-424a61823413","Type":"ContainerStarted","Data":"179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be"}
Jul 13 21:17:06.092609 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:06.092140    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8" event={"ID":"005c8680-e814-4c69-8924-424a61823413","Type":"ContainerStarted","Data":"0eb479ce807ba9458b8468d70f2898ff29ffcddfe53698e6062e32f26fef5625"}
Jul 13 21:17:06.092609 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:06.092234    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"
Jul 13 21:17:06.110769 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:06.110709    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8" podStartSLOduration=2.110692314 podStartE2EDuration="2.110692314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:17:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:17:06.10868389 +0000 UTC m=+469.963828772" watchObservedRunningTime="2026-07-13 21:17:06.110692314 +0000 UTC m=+469.965837195"
Jul 13 21:17:06.715030 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:06.714994    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29d480d6-b146-4656-91a7-1bb8c5702c44" path="/var/lib/kubelet/pods/29d480d6-b146-4656-91a7-1bb8c5702c44/volumes"
Jul 13 21:17:17.101990 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:17.101911    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"
Jul 13 21:17:20.779209 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.779175    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"]
Jul 13 21:17:20.780006 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.779984    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29d480d6-b146-4656-91a7-1bb8c5702c44" containerName="manager"
Jul 13 21:17:20.780095 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.780009    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="29d480d6-b146-4656-91a7-1bb8c5702c44" containerName="manager"
Jul 13 21:17:20.780166 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.780152    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="29d480d6-b146-4656-91a7-1bb8c5702c44" containerName="manager"
Jul 13 21:17:20.784600 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.784579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.786636 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.786617    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-l4lkd\""
Jul 13 21:17:20.795202 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.795176    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"]
Jul 13 21:17:20.829728 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.829690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.829728 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.829734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.829898 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.829768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.829898 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.829791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.829898 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.829815    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.829898 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.829831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d64p4\" (UniqueName: \"kubernetes.io/projected/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-kube-api-access-d64p4\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.830055 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.829913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.830055 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.829954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.830055 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.829974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.930751 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.930716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.930910 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.930758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.930910 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.930789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.930910 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.930810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d64p4\" (UniqueName: \"kubernetes.io/projected/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-kube-api-access-d64p4\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.931079 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.930966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.931079 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.931024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.931079 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.931051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.931229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.931092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.931229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.931108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.931229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.931141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.931229 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.931149    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.931479 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.931414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.931521 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.931497    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.931746 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.931722    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.933246 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.933216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.933450 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.933434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.938531 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.938508    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:20.938742 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:20.938725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d64p4\" (UniqueName: \"kubernetes.io/projected/7a74ec01-192b-49c8-90e2-a8168f8bc7f1-kube-api-access-d64p4\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dgd8s\" (UID: \"7a74ec01-192b-49c8-90e2-a8168f8bc7f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:21.096624 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:21.096543    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:21.234112 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:21.234083    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"]
Jul 13 21:17:21.235766 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:17:21.235726    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a74ec01_192b_49c8_90e2_a8168f8bc7f1.slice/crio-9522f26aa52f17669d893ddaf8be5d015aa0c55077f86903bea36dcda1c04034 WatchSource:0}: Error finding container 9522f26aa52f17669d893ddaf8be5d015aa0c55077f86903bea36dcda1c04034: Status 404 returned error can't find the container with id 9522f26aa52f17669d893ddaf8be5d015aa0c55077f86903bea36dcda1c04034
Jul 13 21:17:21.237999 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:21.237958    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 21:17:21.238092 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:21.238061    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 21:17:21.238136 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:21.238110    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 21:17:22.184638 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:22.184603    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s" event={"ID":"7a74ec01-192b-49c8-90e2-a8168f8bc7f1","Type":"ContainerStarted","Data":"edf2c27c7f3ee7ed8585f88ad7ab7af95b9d01506668a9b9c706c6bc97e55188"}
Jul 13 21:17:22.185042 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:22.184662    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s" event={"ID":"7a74ec01-192b-49c8-90e2-a8168f8bc7f1","Type":"ContainerStarted","Data":"9522f26aa52f17669d893ddaf8be5d015aa0c55077f86903bea36dcda1c04034"}
Jul 13 21:17:22.204397 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:22.204336    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s" podStartSLOduration=2.204321405 podStartE2EDuration="2.204321405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:17:22.201136496 +0000 UTC m=+486.056281377" watchObservedRunningTime="2026-07-13 21:17:22.204321405 +0000 UTC m=+486.059466287"
Jul 13 21:17:23.097133 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:23.097102    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:23.102576 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:23.102551    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:23.190634 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:23.190604    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:23.191426 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:23.191407    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:17:24.930020 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:24.929976    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:17:24.934085 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:24.934059    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj"
Jul 13 21:17:24.935964 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:24.935941    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jctlp\""
Jul 13 21:17:24.936147 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:24.936133    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 21:17:24.941209 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:24.941183    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:17:24.968578 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:24.968544    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:17:25.069498 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:25.069466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zbgx\" (UniqueName: \"kubernetes.io/projected/55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2-kube-api-access-2zbgx\") pod \"limitador-limitador-54d6d988d5-nlczj\" (UID: \"55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj"
Jul 13 21:17:25.069659 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:25.069614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2-config-file\") pod \"limitador-limitador-54d6d988d5-nlczj\" (UID: \"55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj"
Jul 13 21:17:25.170764 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:25.170735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2-config-file\") pod \"limitador-limitador-54d6d988d5-nlczj\" (UID: \"55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj"
Jul 13 21:17:25.170955 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:25.170785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zbgx\" (UniqueName: \"kubernetes.io/projected/55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2-kube-api-access-2zbgx\") pod \"limitador-limitador-54d6d988d5-nlczj\" (UID: \"55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj"
Jul 13 21:17:25.171479 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:25.171455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2-config-file\") pod \"limitador-limitador-54d6d988d5-nlczj\" (UID: \"55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj"
Jul 13 21:17:25.178249 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:25.178223    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zbgx\" (UniqueName: \"kubernetes.io/projected/55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2-kube-api-access-2zbgx\") pod \"limitador-limitador-54d6d988d5-nlczj\" (UID: \"55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj"
Jul 13 21:17:25.248207 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:25.248107    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj"
Jul 13 21:17:25.391886 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:25.391854    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:17:25.393802 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:17:25.393773    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55fd35a8_63ba_4dcb_bb3c_68cd65d5b6d2.slice/crio-3bb38860bf2e0044f09b30134e8c176faf9be45b9995b78e47c67412f1215a48 WatchSource:0}: Error finding container 3bb38860bf2e0044f09b30134e8c176faf9be45b9995b78e47c67412f1215a48: Status 404 returned error can't find the container with id 3bb38860bf2e0044f09b30134e8c176faf9be45b9995b78e47c67412f1215a48
Jul 13 21:17:26.211620 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:26.211576    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj" event={"ID":"55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2","Type":"ContainerStarted","Data":"3bb38860bf2e0044f09b30134e8c176faf9be45b9995b78e47c67412f1215a48"}
Jul 13 21:17:28.225932 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:28.225837    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj" event={"ID":"55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2","Type":"ContainerStarted","Data":"b3f56aaa9cfe36ba12edddcfa47f56c0fb44cfebca4ca6ede96b6a0403fc078a"}
Jul 13 21:17:28.225932 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:28.225904    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj"
Jul 13 21:17:28.242839 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:28.242791    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj" podStartSLOduration=1.748205354 podStartE2EDuration="4.242776888s" totalImagesPullingTime="2.494571534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:17:28.240902181 +0000 UTC m=+492.096047063" watchObservedRunningTime="2026-07-13 21:17:28.242776888 +0000 UTC m=+492.097921774"
Jul 13 21:17:39.232683 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:17:39.232651    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlczj"
Jul 13 21:18:41.033987 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:41.033908    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:18:48.678318 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:48.678282    2580 generic.go:356] "Generic (PLEG): container finished" podID="7a74ec01-192b-49c8-90e2-a8168f8bc7f1" containerID="edf2c27c7f3ee7ed8585f88ad7ab7af95b9d01506668a9b9c706c6bc97e55188" exitCode=0
Jul 13 21:18:48.678852 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:48.678363    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s" event={"ID":"7a74ec01-192b-49c8-90e2-a8168f8bc7f1","Type":"ContainerDied","Data":"edf2c27c7f3ee7ed8585f88ad7ab7af95b9d01506668a9b9c706c6bc97e55188"}
Jul 13 21:18:48.678927 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:48.678866    2580 scope.go:117] "RemoveContainer" containerID="edf2c27c7f3ee7ed8585f88ad7ab7af95b9d01506668a9b9c706c6bc97e55188"
Jul 13 21:18:48.679896 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:48.679871    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 21:18:48.679951 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:48.679938    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 21:18:48.679989 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:48.679968    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 21:18:49.685666 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:49.685636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s" event={"ID":"7a74ec01-192b-49c8-90e2-a8168f8bc7f1","Type":"ContainerStarted","Data":"7efeea7da4f785df37a1ab80a1eac8934e9d20600b7900b13a995fc06000b5ed"}
Jul 13 21:18:50.097660 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:50.097583    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:18:50.098730 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:50.098703    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dgd8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 21:18:50.098855 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:50.098753    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s" podUID="7a74ec01-192b-49c8-90e2-a8168f8bc7f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 21:18:51.097195 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:51.097161    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dgd8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 21:18:51.097604 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:51.097217    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s" podUID="7a74ec01-192b-49c8-90e2-a8168f8bc7f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 21:18:52.097363 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:52.097332    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dgd8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 21:18:52.097749 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:52.097411    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s" podUID="7a74ec01-192b-49c8-90e2-a8168f8bc7f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 21:18:53.097368 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:53.097331    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dgd8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 21:18:53.097785 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:53.097412    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s" podUID="7a74ec01-192b-49c8-90e2-a8168f8bc7f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 21:18:53.190665 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:53.190630    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:18:54.101708 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:54.101681    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:18:54.102927 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:18:54.102905    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dgd8s"
Jul 13 21:19:10.774748 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:19:10.774715    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:19:16.668022 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:19:16.667990    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:19:16.668609 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:19:16.668308    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:19:23.569050 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:19:23.569012    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:19:43.366321 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:19:43.366239    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:19:56.162325 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:19:56.162286    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:20:03.657867 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:03.657832    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:20:16.873163 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.873122    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"]
Jul 13 21:20:16.886681 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.886652    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:16.888243 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.888134    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"]
Jul 13 21:20:16.890005 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.889981    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 21:20:16.890250 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.890229    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 13 21:20:16.890343 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.890262    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 21:20:16.890447 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.890002    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8779s\""
Jul 13 21:20:16.996656 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.996622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:16.996816 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.996668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:16.996816 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.996687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:16.996909 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.996835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:16.996909 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.996880    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8snkh\" (UniqueName: \"kubernetes.io/projected/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-kube-api-access-8snkh\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:16.996987 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:16.996913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.097783 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.097748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.097955 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.097794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.097998 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.097970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.098085 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.098069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.098133 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.098118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8snkh\" (UniqueName: \"kubernetes.io/projected/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-kube-api-access-8snkh\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.098173 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.098128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.098173 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.098158    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.098237 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.098161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.098481 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.098462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.100320 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.100287    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.100558 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.100541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.105720 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.105698    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8snkh\" (UniqueName: \"kubernetes.io/projected/d2ac4ccd-bf07-4262-9e1e-ac748705e8c0-kube-api-access-8snkh\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn\" (UID: \"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.199494 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.199463    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:17.336527 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.336499    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"]
Jul 13 21:20:17.338683 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:20:17.338654    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2ac4ccd_bf07_4262_9e1e_ac748705e8c0.slice/crio-a5f7268c438ccac0c918d24b885fca536fefafb591efdbce2659905c9ee9cf96 WatchSource:0}: Error finding container a5f7268c438ccac0c918d24b885fca536fefafb591efdbce2659905c9ee9cf96: Status 404 returned error can't find the container with id a5f7268c438ccac0c918d24b885fca536fefafb591efdbce2659905c9ee9cf96
Jul 13 21:20:17.340399 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:17.340365    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:20:18.194189 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:18.194150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn" event={"ID":"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0","Type":"ContainerStarted","Data":"a5f7268c438ccac0c918d24b885fca536fefafb591efdbce2659905c9ee9cf96"}
Jul 13 21:20:19.200978 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:19.200942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn" event={"ID":"d2ac4ccd-bf07-4262-9e1e-ac748705e8c0","Type":"ContainerStarted","Data":"7b30044ca93ec2ebc91b63c6283ab62a0c21c1ab689be665d152d1e0c6896a60"}
Jul 13 21:20:19.217483 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:19.217429    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn" podStartSLOduration=2.065106102 podStartE2EDuration="3.21740872s" totalImagesPullingTime="1.152302618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:20:19.216627384 +0000 UTC m=+663.071772267" watchObservedRunningTime="2026-07-13 21:20:19.21740872 +0000 UTC m=+663.072553599"
Jul 13 21:20:19.666743 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:19.666709    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:20:27.199756 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:27.199713    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:27.199756 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:27.199761    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:27.213168 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:27.213141    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:20:27.259069 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:20:27.259038    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn"
Jul 13 21:21:39.068349 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:21:39.068259    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:21:50.263553 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:21:50.263511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:22:00.375260 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:22:00.375222    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:22:10.159475 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:22:10.159443    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:22:20.856913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:22:20.856880    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:22:46.061605 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:22:46.061528    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:22:59.965139 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:22:59.965101    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:23:34.163515 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:23:34.163483    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:23:43.369088 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:23:43.369050    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:23:54.056060 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:23:54.056026    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:24:03.568367 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:24:03.568328    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:24:13.263757 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:24:13.263675    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:24:16.704555 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:24:16.704524    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:24:16.706571 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:24:16.706549    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:24:22.272635 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:24:22.272600    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:24:34.655765 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:24:34.655724    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:24:44.957728 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:24:44.957692    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:25:06.760153 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:25:06.760117    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:25:16.961664 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:25:16.961628    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:25:40.463623 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:25:40.463541    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:25:52.664889 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:25:52.664856    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:26:06.783045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:26:06.783008    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:26:18.857285 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:26:18.857241    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:26:28.167396 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:26:28.167348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:26:40.458799 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:26:40.458760    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:27:11.344253 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:11.344173    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"]
Jul 13 21:27:11.344768 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:11.344369    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8" podUID="005c8680-e814-4c69-8924-424a61823413" containerName="manager" containerID="cri-o://179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be" gracePeriod=10
Jul 13 21:27:14.205817 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.205792    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"
Jul 13 21:27:14.297072 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.296996    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/005c8680-e814-4c69-8924-424a61823413-extensions-socket-volume\") pod \"005c8680-e814-4c69-8924-424a61823413\" (UID: \"005c8680-e814-4c69-8924-424a61823413\") "
Jul 13 21:27:14.297072 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.297031    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvlw6\" (UniqueName: \"kubernetes.io/projected/005c8680-e814-4c69-8924-424a61823413-kube-api-access-lvlw6\") pod \"005c8680-e814-4c69-8924-424a61823413\" (UID: \"005c8680-e814-4c69-8924-424a61823413\") "
Jul 13 21:27:14.297342 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.297320    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/005c8680-e814-4c69-8924-424a61823413-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "005c8680-e814-4c69-8924-424a61823413" (UID: "005c8680-e814-4c69-8924-424a61823413"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:27:14.298984 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.298962    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/005c8680-e814-4c69-8924-424a61823413-kube-api-access-lvlw6" (OuterVolumeSpecName: "kube-api-access-lvlw6") pod "005c8680-e814-4c69-8924-424a61823413" (UID: "005c8680-e814-4c69-8924-424a61823413"). InnerVolumeSpecName "kube-api-access-lvlw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:27:14.398510 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.398479    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/005c8680-e814-4c69-8924-424a61823413-extensions-socket-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:27:14.398510 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.398507    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvlw6\" (UniqueName: \"kubernetes.io/projected/005c8680-e814-4c69-8924-424a61823413-kube-api-access-lvlw6\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:27:14.576815 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.576733    2580 generic.go:356] "Generic (PLEG): container finished" podID="005c8680-e814-4c69-8924-424a61823413" containerID="179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be" exitCode=0
Jul 13 21:27:14.576815 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.576785    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"
Jul 13 21:27:14.577020 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.576816    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8" event={"ID":"005c8680-e814-4c69-8924-424a61823413","Type":"ContainerDied","Data":"179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be"}
Jul 13 21:27:14.577020 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.576870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8" event={"ID":"005c8680-e814-4c69-8924-424a61823413","Type":"ContainerDied","Data":"0eb479ce807ba9458b8468d70f2898ff29ffcddfe53698e6062e32f26fef5625"}
Jul 13 21:27:14.577020 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.576894    2580 scope.go:117] "RemoveContainer" containerID="179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be"
Jul 13 21:27:14.588008 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.587991    2580 scope.go:117] "RemoveContainer" containerID="179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be"
Jul 13 21:27:14.588251 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:27:14.588232    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be\": container with ID starting with 179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be not found: ID does not exist" containerID="179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be"
Jul 13 21:27:14.588305 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.588262    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be"} err="failed to get container status \"179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be\": rpc error: code = NotFound desc = could not find container \"179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be\": container with ID starting with 179eaa677f6a2752d886897bf6504ab3787e2d6a1059d46f51dc8bcf811b54be not found: ID does not exist"
Jul 13 21:27:14.597858 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.597836    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"]
Jul 13 21:27:14.601097 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.601076    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzrt8"]
Jul 13 21:27:14.714429 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:27:14.714362    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="005c8680-e814-4c69-8924-424a61823413" path="/var/lib/kubelet/pods/005c8680-e814-4c69-8924-424a61823413/volumes"
Jul 13 21:28:12.425706 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.425667    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"]
Jul 13 21:28:12.426227 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.426102    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="005c8680-e814-4c69-8924-424a61823413" containerName="manager"
Jul 13 21:28:12.426227 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.426114    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="005c8680-e814-4c69-8924-424a61823413" containerName="manager"
Jul 13 21:28:12.426227 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.426191    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="005c8680-e814-4c69-8924-424a61823413" containerName="manager"
Jul 13 21:28:12.429308 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.429291    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"
Jul 13 21:28:12.431801 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.431779    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w5gbw\""
Jul 13 21:28:12.441136 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.441080    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"]
Jul 13 21:28:12.537595 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.537558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fb1f97d-dd39-454f-90d4-e4fa6e88e51b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xsbvp\" (UID: \"9fb1f97d-dd39-454f-90d4-e4fa6e88e51b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"
Jul 13 21:28:12.537801 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.537684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qdmr\" (UniqueName: \"kubernetes.io/projected/9fb1f97d-dd39-454f-90d4-e4fa6e88e51b-kube-api-access-4qdmr\") pod \"kuadrant-operator-controller-manager-86878c769f-xsbvp\" (UID: \"9fb1f97d-dd39-454f-90d4-e4fa6e88e51b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"
Jul 13 21:28:12.638798 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.638759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qdmr\" (UniqueName: \"kubernetes.io/projected/9fb1f97d-dd39-454f-90d4-e4fa6e88e51b-kube-api-access-4qdmr\") pod \"kuadrant-operator-controller-manager-86878c769f-xsbvp\" (UID: \"9fb1f97d-dd39-454f-90d4-e4fa6e88e51b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"
Jul 13 21:28:12.638993 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.638856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fb1f97d-dd39-454f-90d4-e4fa6e88e51b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xsbvp\" (UID: \"9fb1f97d-dd39-454f-90d4-e4fa6e88e51b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"
Jul 13 21:28:12.639234 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.639213    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fb1f97d-dd39-454f-90d4-e4fa6e88e51b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xsbvp\" (UID: \"9fb1f97d-dd39-454f-90d4-e4fa6e88e51b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"
Jul 13 21:28:12.647692 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.647666    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qdmr\" (UniqueName: \"kubernetes.io/projected/9fb1f97d-dd39-454f-90d4-e4fa6e88e51b-kube-api-access-4qdmr\") pod \"kuadrant-operator-controller-manager-86878c769f-xsbvp\" (UID: \"9fb1f97d-dd39-454f-90d4-e4fa6e88e51b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"
Jul 13 21:28:12.740335 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.740245    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"
Jul 13 21:28:12.884317 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.884286    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"]
Jul 13 21:28:12.885002 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:28:12.884975    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb1f97d_dd39_454f_90d4_e4fa6e88e51b.slice/crio-7f48105fe75327a2f384a9912ca9d5459c270cb00b697a393ad90ef96061fdf2 WatchSource:0}: Error finding container 7f48105fe75327a2f384a9912ca9d5459c270cb00b697a393ad90ef96061fdf2: Status 404 returned error can't find the container with id 7f48105fe75327a2f384a9912ca9d5459c270cb00b697a393ad90ef96061fdf2
Jul 13 21:28:12.912687 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:12.912657    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp" event={"ID":"9fb1f97d-dd39-454f-90d4-e4fa6e88e51b","Type":"ContainerStarted","Data":"7f48105fe75327a2f384a9912ca9d5459c270cb00b697a393ad90ef96061fdf2"}
Jul 13 21:28:13.920173 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:13.920130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp" event={"ID":"9fb1f97d-dd39-454f-90d4-e4fa6e88e51b","Type":"ContainerStarted","Data":"25afe44f8f82be42c6c7908b491ba42cadcd108ac135022335ffa12af67ecb66"}
Jul 13 21:28:13.920562 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:13.920202    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"
Jul 13 21:28:13.939415 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:13.939326    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp" podStartSLOduration=1.939310589 podStartE2EDuration="1.939310589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:28:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:28:13.937873204 +0000 UTC m=+1137.793018086" watchObservedRunningTime="2026-07-13 21:28:13.939310589 +0000 UTC m=+1137.794455470"
Jul 13 21:28:24.927907 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:24.927879    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbvp"
Jul 13 21:28:34.160889 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:34.160859    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:28:43.559777 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:43.559693    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:28:59.667728 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:28:59.667687    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:29:08.760329 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:29:08.760298    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:29:16.748524 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:29:16.748499    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:29:16.752418 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:29:16.752372    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:29:21.057994 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:29:21.057952    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:29:30.561458 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:29:30.561426    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:29:40.368771 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:29:40.368734    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:29:51.164632 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:29:51.164596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:30:02.160961 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:30:02.160929    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:30:10.960260 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:30:10.960184    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:30:21.366991 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:30:21.366945    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:30:45.769566 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:30:45.769530    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:30:53.456454 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:30:53.456420    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:31:02.762779 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:31:02.762748    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:31:12.560652 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:31:12.560620    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:31:19.361864 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:31:19.361824    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:31:35.163334 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:31:35.163294    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:31:48.869551 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:31:48.869471    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:31:57.063130 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:31:57.063094    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:32:02.861474 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:32:02.861444    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:32:12.285032 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:32:12.284998    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:32:22.054962 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:32:22.054931    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:32:35.865902 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:32:35.865863    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:32:50.066872 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:32:50.066838    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:32:59.558532 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:32:59.558499    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:33:08.563288 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:33:08.563251    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:33:19.958665 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:33:19.958627    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:33:36.263971 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:33:36.263924    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:33:48.654529 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:33:48.654489    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:33:57.860894 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:33:57.860852    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:34:11.359107 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:34:11.359072    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:34:16.787376 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:34:16.787350    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:34:16.792045 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:34:16.792026    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:34:25.759537 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:34:25.759503    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:34:35.658873 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:34:35.658835    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:35:50.357670 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:35:50.357635    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:36:10.964003 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:36:10.963971    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:37:11.571109 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:37:11.571072    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:37:25.159336 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:37:25.159294    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:38:40.359881 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:38:40.359845    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:38:57.062815 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:38:57.062773    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:39:16.825075 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:39:16.825044    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:39:16.831572 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:39:16.831552    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:40:02.063752 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:40:02.063714    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:41:37.069040 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:41:37.069002    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:41:46.562880 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:41:46.562851    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:41:57.563243 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:41:57.563209    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:42:16.965276 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:42:16.965203    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:42:58.962095 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:42:58.962058    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:43:19.364705 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.364668    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"]
Jul 13 21:43:19.368531 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.368510    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.370620 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.370598    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6c7d8be7\"/\"openshift-service-ca.crt\""
Jul 13 21:43:19.371455 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.371435    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6c7d8be7\"/\"kube-root-ca.crt\""
Jul 13 21:43:19.371562 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.371513    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6c7d8be7\"/\"e2e-lifecycle-model-6c7d8be7-kserve-self-signed-certs\""
Jul 13 21:43:19.371629 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.371578    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6c7d8be7\"/\"default-dockercfg-rvdp4\""
Jul 13 21:43:19.375891 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.375870    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"]
Jul 13 21:43:19.484744 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.484705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-home\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.484918 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.484802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-model-cache\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.484918 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.484819    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-dshm\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.484999 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.484962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-tmp-dir\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.485034 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.485012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmqcs\" (UniqueName: \"kubernetes.io/projected/29d125f9-ac41-47e5-9b48-d66baa8b9666-kube-api-access-lmqcs\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.485069 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.485034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29d125f9-ac41-47e5-9b48-d66baa8b9666-tls-certs\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.586396 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.586360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmqcs\" (UniqueName: \"kubernetes.io/projected/29d125f9-ac41-47e5-9b48-d66baa8b9666-kube-api-access-lmqcs\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.586590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.586420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29d125f9-ac41-47e5-9b48-d66baa8b9666-tls-certs\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.586590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.586447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-home\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.586590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.586496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-model-cache\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.586590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.586514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-dshm\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.586590 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.586585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-tmp-dir\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.586921 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.586861    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-home\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.586976 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.586929    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-model-cache\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.587034 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.587015    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-tmp-dir\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.588821 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.588803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-dshm\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.589213 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.589191    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29d125f9-ac41-47e5-9b48-d66baa8b9666-tls-certs\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.594171 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.594149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmqcs\" (UniqueName: \"kubernetes.io/projected/29d125f9-ac41-47e5-9b48-d66baa8b9666-kube-api-access-lmqcs\") pod \"e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") " pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.679011 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.678982    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:19.821112 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:19.821079    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"]
Jul 13 21:43:19.823056 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:43:19.823025    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29d125f9_ac41_47e5_9b48_d66baa8b9666.slice/crio-60d52c9b187e1d1856028d32b963f2540825ff7d40d9a92965469fb218c0d569 WatchSource:0}: Error finding container 60d52c9b187e1d1856028d32b963f2540825ff7d40d9a92965469fb218c0d569: Status 404 returned error can't find the container with id 60d52c9b187e1d1856028d32b963f2540825ff7d40d9a92965469fb218c0d569
Jul 13 21:43:20.113452 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:20.113325    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn" event={"ID":"29d125f9-ac41-47e5-9b48-d66baa8b9666","Type":"ContainerStarted","Data":"3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1"}
Jul 13 21:43:20.113718 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:20.113679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn" event={"ID":"29d125f9-ac41-47e5-9b48-d66baa8b9666","Type":"ContainerStarted","Data":"60d52c9b187e1d1856028d32b963f2540825ff7d40d9a92965469fb218c0d569"}
Jul 13 21:43:20.132177 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:20.132126    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn" podStartSLOduration=1.132111383 podStartE2EDuration="1.132111383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:43:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:43:20.129024927 +0000 UTC m=+2043.984169820" watchObservedRunningTime="2026-07-13 21:43:20.132111383 +0000 UTC m=+2043.987256266"
Jul 13 21:43:22.566576 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:22.566541    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:43:29.679539 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:29.679509    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:29.679968 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:29.679653    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:29.692700 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:29.692679    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:30.179633 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:30.179607    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:43:40.866539 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:43:40.866459    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:44:00.662614 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:00.662577    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:44:06.699498 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:06.699459    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"]
Jul 13 21:44:16.869852 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:16.869821    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:44:16.875635 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:16.875614    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:44:21.722093 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:21.722025    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn" podUID="29d125f9-ac41-47e5-9b48-d66baa8b9666" containerName="main" containerID="cri-o://3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1" gracePeriod=45
Jul 13 21:44:21.977917 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:21.977857    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:44:22.091257 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.091228    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-tmp-dir\") pod \"29d125f9-ac41-47e5-9b48-d66baa8b9666\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") "
Jul 13 21:44:22.091465 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.091266    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-dshm\") pod \"29d125f9-ac41-47e5-9b48-d66baa8b9666\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") "
Jul 13 21:44:22.091465 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.091297    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmqcs\" (UniqueName: \"kubernetes.io/projected/29d125f9-ac41-47e5-9b48-d66baa8b9666-kube-api-access-lmqcs\") pod \"29d125f9-ac41-47e5-9b48-d66baa8b9666\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") "
Jul 13 21:44:22.091465 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.091315    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-home\") pod \"29d125f9-ac41-47e5-9b48-d66baa8b9666\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") "
Jul 13 21:44:22.091465 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.091438    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-model-cache\") pod \"29d125f9-ac41-47e5-9b48-d66baa8b9666\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") "
Jul 13 21:44:22.091699 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.091477    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29d125f9-ac41-47e5-9b48-d66baa8b9666-tls-certs\") pod \"29d125f9-ac41-47e5-9b48-d66baa8b9666\" (UID: \"29d125f9-ac41-47e5-9b48-d66baa8b9666\") "
Jul 13 21:44:22.091699 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.091586    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "29d125f9-ac41-47e5-9b48-d66baa8b9666" (UID: "29d125f9-ac41-47e5-9b48-d66baa8b9666"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:44:22.091699 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.091657    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-home" (OuterVolumeSpecName: "home") pod "29d125f9-ac41-47e5-9b48-d66baa8b9666" (UID: "29d125f9-ac41-47e5-9b48-d66baa8b9666"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:44:22.091699 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.091672    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-model-cache" (OuterVolumeSpecName: "model-cache") pod "29d125f9-ac41-47e5-9b48-d66baa8b9666" (UID: "29d125f9-ac41-47e5-9b48-d66baa8b9666"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:44:22.091920 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.091814    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-tmp-dir\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:44:22.091920 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.091830    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-home\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:44:22.091920 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.091842    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-model-cache\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:44:22.093523 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.093501    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-dshm" (OuterVolumeSpecName: "dshm") pod "29d125f9-ac41-47e5-9b48-d66baa8b9666" (UID: "29d125f9-ac41-47e5-9b48-d66baa8b9666"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:44:22.093642 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.093607    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29d125f9-ac41-47e5-9b48-d66baa8b9666-kube-api-access-lmqcs" (OuterVolumeSpecName: "kube-api-access-lmqcs") pod "29d125f9-ac41-47e5-9b48-d66baa8b9666" (UID: "29d125f9-ac41-47e5-9b48-d66baa8b9666"). InnerVolumeSpecName "kube-api-access-lmqcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:44:22.093642 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.093631    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29d125f9-ac41-47e5-9b48-d66baa8b9666-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "29d125f9-ac41-47e5-9b48-d66baa8b9666" (UID: "29d125f9-ac41-47e5-9b48-d66baa8b9666"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:44:22.192756 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.192725    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29d125f9-ac41-47e5-9b48-d66baa8b9666-tls-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:44:22.192756 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.192751    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29d125f9-ac41-47e5-9b48-d66baa8b9666-dshm\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:44:22.192756 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.192760    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmqcs\" (UniqueName: \"kubernetes.io/projected/29d125f9-ac41-47e5-9b48-d66baa8b9666-kube-api-access-lmqcs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:44:22.473977 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.473944    2580 generic.go:356] "Generic (PLEG): container finished" podID="29d125f9-ac41-47e5-9b48-d66baa8b9666" containerID="3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1" exitCode=0
Jul 13 21:44:22.474146 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.473983    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"
Jul 13 21:44:22.474146 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.474018    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn" event={"ID":"29d125f9-ac41-47e5-9b48-d66baa8b9666","Type":"ContainerDied","Data":"3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1"}
Jul 13 21:44:22.474146 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.474054    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn" event={"ID":"29d125f9-ac41-47e5-9b48-d66baa8b9666","Type":"ContainerDied","Data":"60d52c9b187e1d1856028d32b963f2540825ff7d40d9a92965469fb218c0d569"}
Jul 13 21:44:22.474146 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.474072    2580 scope.go:117] "RemoveContainer" containerID="3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1"
Jul 13 21:44:22.484185 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.484166    2580 scope.go:117] "RemoveContainer" containerID="3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1"
Jul 13 21:44:22.484478 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:44:22.484461    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1\": container with ID starting with 3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1 not found: ID does not exist" containerID="3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1"
Jul 13 21:44:22.484544 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.484488    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1"} err="failed to get container status \"3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1\": rpc error: code = NotFound desc = could not find container \"3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1\": container with ID starting with 3ea7ddf451a7e735fb8d8f12fd21a2c47630746b20a0449e4deb1986c03450d1 not found: ID does not exist"
Jul 13 21:44:22.496433 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.496412    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"]
Jul 13 21:44:22.501203 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.501178    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-6c7d8be7/e2e-lifecycle-model-6c7d8be7-kserve-5567f56579-5gcpn"]
Jul 13 21:44:22.714557 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:44:22.714524    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29d125f9-ac41-47e5-9b48-d66baa8b9666" path="/var/lib/kubelet/pods/29d125f9-ac41-47e5-9b48-d66baa8b9666/volumes"
Jul 13 21:45:18.160592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:45:18.160555    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:45:31.556976 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:45:31.556941    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:46:19.376423 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:19.376370    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:46:30.768795 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:30.768756    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:46:36.261049 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.261018    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"]
Jul 13 21:46:36.261717 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.261692    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29d125f9-ac41-47e5-9b48-d66baa8b9666" containerName="main"
Jul 13 21:46:36.261717 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.261715    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="29d125f9-ac41-47e5-9b48-d66baa8b9666" containerName="main"
Jul 13 21:46:36.261887 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.261805    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="29d125f9-ac41-47e5-9b48-d66baa8b9666" containerName="main"
Jul 13 21:46:36.265363 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.265336    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.267628 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.267606    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8c4d43\"/\"openshift-service-ca.crt\""
Jul 13 21:46:36.267743 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.267640    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8c4d43\"/\"kube-root-ca.crt\""
Jul 13 21:46:36.268425 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.268401    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8c4d43\"/\"test-model-8c4d43-kserve-self-signed-certs\""
Jul 13 21:46:36.268522 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.268431    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8c4d43\"/\"default-dockercfg-69944\""
Jul 13 21:46:36.275014 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.274985    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"]
Jul 13 21:46:36.369271 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.369235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-tmp-dir\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.369271 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.369276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-model-cache\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.369503 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.369365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwgdc\" (UniqueName: \"kubernetes.io/projected/4addad1d-333e-48c3-93d3-9735e494360a-kube-api-access-bwgdc\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.369503 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.369435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-home\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.369577 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.369514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4addad1d-333e-48c3-93d3-9735e494360a-tls-certs\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.369577 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.369548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-dshm\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.470042 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.470001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwgdc\" (UniqueName: \"kubernetes.io/projected/4addad1d-333e-48c3-93d3-9735e494360a-kube-api-access-bwgdc\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.470224 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.470055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-home\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.470224 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.470102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4addad1d-333e-48c3-93d3-9735e494360a-tls-certs\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.470224 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.470138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-dshm\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.470224 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.470210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-tmp-dir\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.470473 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.470243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-model-cache\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.470630 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.470582    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-home\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.470765 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.470673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-model-cache\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.470765 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.470724    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-tmp-dir\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.472519 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.472496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-dshm\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.472721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.472703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4addad1d-333e-48c3-93d3-9735e494360a-tls-certs\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.480023 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.479999    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwgdc\" (UniqueName: \"kubernetes.io/projected/4addad1d-333e-48c3-93d3-9735e494360a-kube-api-access-bwgdc\") pod \"test-model-8c4d43-kserve-778f8fb989-dp8k2\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") " pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.575893 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.575802    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:36.715765 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:36.715736    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"]
Jul 13 21:46:36.717289 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:46:36.717261    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4addad1d_333e_48c3_93d3_9735e494360a.slice/crio-01f7b35d84c9c1240ef98576f708aa8c8fbc65e915ff19cb8c0e0289714d9c11 WatchSource:0}: Error finding container 01f7b35d84c9c1240ef98576f708aa8c8fbc65e915ff19cb8c0e0289714d9c11: Status 404 returned error can't find the container with id 01f7b35d84c9c1240ef98576f708aa8c8fbc65e915ff19cb8c0e0289714d9c11
Jul 13 21:46:37.258185 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:37.258154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2" event={"ID":"4addad1d-333e-48c3-93d3-9735e494360a","Type":"ContainerStarted","Data":"19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b"}
Jul 13 21:46:37.258185 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:37.258190    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2" event={"ID":"4addad1d-333e-48c3-93d3-9735e494360a","Type":"ContainerStarted","Data":"01f7b35d84c9c1240ef98576f708aa8c8fbc65e915ff19cb8c0e0289714d9c11"}
Jul 13 21:46:37.275978 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:37.275933    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2" podStartSLOduration=1.2759189229999999 podStartE2EDuration="1.275918923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:46:37.273464556 +0000 UTC m=+2241.128609441" watchObservedRunningTime="2026-07-13 21:46:37.275918923 +0000 UTC m=+2241.131063805"
Jul 13 21:46:38.763495 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:38.763409    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:46:46.576716 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:46.576677    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:46.577123 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:46.576733    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:46.589692 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:46.589670    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:47.329056 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:47.329027    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:46:52.967580 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:46:52.967542    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:47:06.967108 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:06.967072    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"]
Jul 13 21:47:06.971460 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:06.971438    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:06.974557 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:06.974532    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2522e6\"/\"default-dockercfg-8d6nc\""
Jul 13 21:47:06.974738 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:06.974546    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2522e6\"/\"test-model-2522e6-kserve-self-signed-certs\""
Jul 13 21:47:06.974835 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:06.974581    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2522e6\"/\"openshift-service-ca.crt\""
Jul 13 21:47:06.974835 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:06.974605    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2522e6\"/\"kube-root-ca.crt\""
Jul 13 21:47:06.978783 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:06.978760    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"]
Jul 13 21:47:07.062242 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.062209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-tmp-dir\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.062242 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.062246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-dshm\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.062494 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.062273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cae7ab34-21f6-4e27-8bea-0d2060c5766e-tls-certs\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.062494 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.062340    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-home\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.062494 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.062459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg8h6\" (UniqueName: \"kubernetes.io/projected/cae7ab34-21f6-4e27-8bea-0d2060c5766e-kube-api-access-mg8h6\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.062494 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.062479    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-model-cache\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.163847 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.163819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg8h6\" (UniqueName: \"kubernetes.io/projected/cae7ab34-21f6-4e27-8bea-0d2060c5766e-kube-api-access-mg8h6\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.163847 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.163851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-model-cache\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.164080 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.163890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-tmp-dir\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.164080 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.163920    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-dshm\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.164080 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.163947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cae7ab34-21f6-4e27-8bea-0d2060c5766e-tls-certs\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.164080 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.163990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-home\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.164318 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.164296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-tmp-dir\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.164375 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.164360    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-home\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.164484 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.164461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-model-cache\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.166254 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.166234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-dshm\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.166530 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.166514    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cae7ab34-21f6-4e27-8bea-0d2060c5766e-tls-certs\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.171757 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.171735    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg8h6\" (UniqueName: \"kubernetes.io/projected/cae7ab34-21f6-4e27-8bea-0d2060c5766e-kube-api-access-mg8h6\") pod \"test-model-2522e6-kserve-587f479b5-94n2c\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") " pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.284289 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.284206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:07.431007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:07.430972    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"]
Jul 13 21:47:07.432370 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:47:07.432341    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcae7ab34_21f6_4e27_8bea_0d2060c5766e.slice/crio-9de0af255fe6c7d26761d41b73a4dab19619e49652a0a9946b256276a6349eea WatchSource:0}: Error finding container 9de0af255fe6c7d26761d41b73a4dab19619e49652a0a9946b256276a6349eea: Status 404 returned error can't find the container with id 9de0af255fe6c7d26761d41b73a4dab19619e49652a0a9946b256276a6349eea
Jul 13 21:47:08.447124 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:08.447090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c" event={"ID":"cae7ab34-21f6-4e27-8bea-0d2060c5766e","Type":"ContainerStarted","Data":"4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26"}
Jul 13 21:47:08.447124 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:08.447130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c" event={"ID":"cae7ab34-21f6-4e27-8bea-0d2060c5766e","Type":"ContainerStarted","Data":"9de0af255fe6c7d26761d41b73a4dab19619e49652a0a9946b256276a6349eea"}
Jul 13 21:47:08.464709 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:08.464662    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c" podStartSLOduration=2.464648109 podStartE2EDuration="2.464648109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:47:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:47:08.463555334 +0000 UTC m=+2272.318700215" watchObservedRunningTime="2026-07-13 21:47:08.464648109 +0000 UTC m=+2272.319793016"
Jul 13 21:47:11.263912 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:11.263877    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:47:17.284955 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:17.284912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:17.285344 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:17.284974    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:17.297226 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:17.297202    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:17.510118 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:17.510079    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:25.963071 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:25.963034    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:47:32.342723 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:32.342687    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"]
Jul 13 21:47:33.246949 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:33.246911    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"]
Jul 13 21:47:39.456254 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:39.456217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:47:47.363040 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.362996    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2" podUID="4addad1d-333e-48c3-93d3-9735e494360a" containerName="main" containerID="cri-o://19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b" gracePeriod=45
Jul 13 21:47:47.622785 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.622723    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:47:47.674435 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.674369    2580 generic.go:356] "Generic (PLEG): container finished" podID="4addad1d-333e-48c3-93d3-9735e494360a" containerID="19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b" exitCode=0
Jul 13 21:47:47.674435 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.674427    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2" event={"ID":"4addad1d-333e-48c3-93d3-9735e494360a","Type":"ContainerDied","Data":"19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b"}
Jul 13 21:47:47.674635 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.674446    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"
Jul 13 21:47:47.674635 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.674478    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2" event={"ID":"4addad1d-333e-48c3-93d3-9735e494360a","Type":"ContainerDied","Data":"01f7b35d84c9c1240ef98576f708aa8c8fbc65e915ff19cb8c0e0289714d9c11"}
Jul 13 21:47:47.674635 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.674501    2580 scope.go:117] "RemoveContainer" containerID="19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b"
Jul 13 21:47:47.683561 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.683539    2580 scope.go:117] "RemoveContainer" containerID="19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b"
Jul 13 21:47:47.683817 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:47:47.683799    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b\": container with ID starting with 19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b not found: ID does not exist" containerID="19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b"
Jul 13 21:47:47.683869 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.683827    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b"} err="failed to get container status \"19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b\": rpc error: code = NotFound desc = could not find container \"19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b\": container with ID starting with 19c2b7c17611df7039bcacacd878d2283e995b5f407deb84eb12badf4fdaa94b not found: ID does not exist"
Jul 13 21:47:47.760882 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.760846    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-model-cache\") pod \"4addad1d-333e-48c3-93d3-9735e494360a\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") "
Jul 13 21:47:47.761068 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.760903    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwgdc\" (UniqueName: \"kubernetes.io/projected/4addad1d-333e-48c3-93d3-9735e494360a-kube-api-access-bwgdc\") pod \"4addad1d-333e-48c3-93d3-9735e494360a\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") "
Jul 13 21:47:47.761068 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.760938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-home\") pod \"4addad1d-333e-48c3-93d3-9735e494360a\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") "
Jul 13 21:47:47.761068 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.760969    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-dshm\") pod \"4addad1d-333e-48c3-93d3-9735e494360a\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") "
Jul 13 21:47:47.761068 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.761030    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-tmp-dir\") pod \"4addad1d-333e-48c3-93d3-9735e494360a\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") "
Jul 13 21:47:47.761298 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.761096    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4addad1d-333e-48c3-93d3-9735e494360a-tls-certs\") pod \"4addad1d-333e-48c3-93d3-9735e494360a\" (UID: \"4addad1d-333e-48c3-93d3-9735e494360a\") "
Jul 13 21:47:47.761298 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.761114    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-model-cache" (OuterVolumeSpecName: "model-cache") pod "4addad1d-333e-48c3-93d3-9735e494360a" (UID: "4addad1d-333e-48c3-93d3-9735e494360a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:47.761298 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.761236    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-home" (OuterVolumeSpecName: "home") pod "4addad1d-333e-48c3-93d3-9735e494360a" (UID: "4addad1d-333e-48c3-93d3-9735e494360a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:47.761298 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.761291    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4addad1d-333e-48c3-93d3-9735e494360a" (UID: "4addad1d-333e-48c3-93d3-9735e494360a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:47.761577 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.761551    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-tmp-dir\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:47:47.761577 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.761577    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-model-cache\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:47:47.761577 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.761592    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-home\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:47:47.763276 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.763249    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4addad1d-333e-48c3-93d3-9735e494360a-kube-api-access-bwgdc" (OuterVolumeSpecName: "kube-api-access-bwgdc") pod "4addad1d-333e-48c3-93d3-9735e494360a" (UID: "4addad1d-333e-48c3-93d3-9735e494360a"). InnerVolumeSpecName "kube-api-access-bwgdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:47:47.763626 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.763598    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-dshm" (OuterVolumeSpecName: "dshm") pod "4addad1d-333e-48c3-93d3-9735e494360a" (UID: "4addad1d-333e-48c3-93d3-9735e494360a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:47.763626 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.763595    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4addad1d-333e-48c3-93d3-9735e494360a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4addad1d-333e-48c3-93d3-9735e494360a" (UID: "4addad1d-333e-48c3-93d3-9735e494360a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:47:47.862990 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.862952    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4addad1d-333e-48c3-93d3-9735e494360a-tls-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:47:47.862990 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.862986    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwgdc\" (UniqueName: \"kubernetes.io/projected/4addad1d-333e-48c3-93d3-9735e494360a-kube-api-access-bwgdc\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:47:47.862990 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.862996    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4addad1d-333e-48c3-93d3-9735e494360a-dshm\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:47:47.995928 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:47.995898    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"]
Jul 13 21:47:48.001233 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.001206    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-8c4d43/test-model-8c4d43-kserve-778f8fb989-dp8k2"]
Jul 13 21:47:48.267916 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.267825    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c" podUID="cae7ab34-21f6-4e27-8bea-0d2060c5766e" containerName="main" containerID="cri-o://4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26" gracePeriod=45
Jul 13 21:47:48.517626 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.517598    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:48.570201 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.570139    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cae7ab34-21f6-4e27-8bea-0d2060c5766e-tls-certs\") pod \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") "
Jul 13 21:47:48.570201 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.570185    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-home\") pod \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") "
Jul 13 21:47:48.570374 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.570218    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-model-cache\") pod \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") "
Jul 13 21:47:48.570374 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.570267    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg8h6\" (UniqueName: \"kubernetes.io/projected/cae7ab34-21f6-4e27-8bea-0d2060c5766e-kube-api-access-mg8h6\") pod \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") "
Jul 13 21:47:48.570374 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.570294    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-dshm\") pod \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") "
Jul 13 21:47:48.570374 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.570344    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-tmp-dir\") pod \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\" (UID: \"cae7ab34-21f6-4e27-8bea-0d2060c5766e\") "
Jul 13 21:47:48.570675 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.570520    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-home" (OuterVolumeSpecName: "home") pod "cae7ab34-21f6-4e27-8bea-0d2060c5766e" (UID: "cae7ab34-21f6-4e27-8bea-0d2060c5766e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:48.570675 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.570548    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-model-cache" (OuterVolumeSpecName: "model-cache") pod "cae7ab34-21f6-4e27-8bea-0d2060c5766e" (UID: "cae7ab34-21f6-4e27-8bea-0d2060c5766e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:48.570675 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.570607    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cae7ab34-21f6-4e27-8bea-0d2060c5766e" (UID: "cae7ab34-21f6-4e27-8bea-0d2060c5766e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:48.570832 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.570813    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-tmp-dir\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:47:48.570874 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.570837    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-home\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:47:48.570874 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.570851    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-model-cache\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:47:48.572329 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.572301    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae7ab34-21f6-4e27-8bea-0d2060c5766e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cae7ab34-21f6-4e27-8bea-0d2060c5766e" (UID: "cae7ab34-21f6-4e27-8bea-0d2060c5766e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:47:48.572472 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.572439    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cae7ab34-21f6-4e27-8bea-0d2060c5766e-kube-api-access-mg8h6" (OuterVolumeSpecName: "kube-api-access-mg8h6") pod "cae7ab34-21f6-4e27-8bea-0d2060c5766e" (UID: "cae7ab34-21f6-4e27-8bea-0d2060c5766e"). InnerVolumeSpecName "kube-api-access-mg8h6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:47:48.572551 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.572532    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-dshm" (OuterVolumeSpecName: "dshm") pod "cae7ab34-21f6-4e27-8bea-0d2060c5766e" (UID: "cae7ab34-21f6-4e27-8bea-0d2060c5766e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:48.671877 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.671847    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cae7ab34-21f6-4e27-8bea-0d2060c5766e-tls-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:47:48.671877 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.671873    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg8h6\" (UniqueName: \"kubernetes.io/projected/cae7ab34-21f6-4e27-8bea-0d2060c5766e-kube-api-access-mg8h6\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:47:48.671877 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.671883    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cae7ab34-21f6-4e27-8bea-0d2060c5766e-dshm\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:47:48.681799 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.681773    2580 generic.go:356] "Generic (PLEG): container finished" podID="cae7ab34-21f6-4e27-8bea-0d2060c5766e" containerID="4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26" exitCode=0
Jul 13 21:47:48.681903 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.681820    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"
Jul 13 21:47:48.681903 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.681849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c" event={"ID":"cae7ab34-21f6-4e27-8bea-0d2060c5766e","Type":"ContainerDied","Data":"4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26"}
Jul 13 21:47:48.681903 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.681888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c" event={"ID":"cae7ab34-21f6-4e27-8bea-0d2060c5766e","Type":"ContainerDied","Data":"9de0af255fe6c7d26761d41b73a4dab19619e49652a0a9946b256276a6349eea"}
Jul 13 21:47:48.682013 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.681905    2580 scope.go:117] "RemoveContainer" containerID="4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26"
Jul 13 21:47:48.692327 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.692310    2580 scope.go:117] "RemoveContainer" containerID="4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26"
Jul 13 21:47:48.692610 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:47:48.692592    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26\": container with ID starting with 4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26 not found: ID does not exist" containerID="4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26"
Jul 13 21:47:48.692669 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.692618    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26"} err="failed to get container status \"4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26\": rpc error: code = NotFound desc = could not find container \"4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26\": container with ID starting with 4f934bb734ce87aeb847ea4270d691edb259bca29a25d04515b3d1a8cfa0df26 not found: ID does not exist"
Jul 13 21:47:48.704722 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.704697    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"]
Jul 13 21:47:48.707823 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.707800    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2522e6/test-model-2522e6-kserve-587f479b5-94n2c"]
Jul 13 21:47:48.715103 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.715078    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4addad1d-333e-48c3-93d3-9735e494360a" path="/var/lib/kubelet/pods/4addad1d-333e-48c3-93d3-9735e494360a/volumes"
Jul 13 21:47:48.715571 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:48.715552    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cae7ab34-21f6-4e27-8bea-0d2060c5766e" path="/var/lib/kubelet/pods/cae7ab34-21f6-4e27-8bea-0d2060c5766e/volumes"
Jul 13 21:47:53.560755 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:47:53.560715    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:48:13.462603 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:48:13.462524    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:48:35.062444 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:48:35.062408    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:48:47.566870 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:48:47.566836    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:49:03.462962 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:03.462929    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:49:15.607463 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.607425    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq"]
Jul 13 21:49:15.608055 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.608034    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae7ab34-21f6-4e27-8bea-0d2060c5766e" containerName="main"
Jul 13 21:49:15.608098 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.608058    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae7ab34-21f6-4e27-8bea-0d2060c5766e" containerName="main"
Jul 13 21:49:15.608098 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.608096    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4addad1d-333e-48c3-93d3-9735e494360a" containerName="main"
Jul 13 21:49:15.608162 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.608105    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4addad1d-333e-48c3-93d3-9735e494360a" containerName="main"
Jul 13 21:49:15.608243 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.608231    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cae7ab34-21f6-4e27-8bea-0d2060c5766e" containerName="main"
Jul 13 21:49:15.608289 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.608248    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4addad1d-333e-48c3-93d3-9735e494360a" containerName="main"
Jul 13 21:49:15.611921 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.611904    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq"
Jul 13 21:49:15.614541 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.614297    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:49:15.614541 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.614347    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xxvfz\""
Jul 13 21:49:15.616850 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.616828    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq"]
Jul 13 21:49:15.676754 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.676712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2a4a17-a7f9-452a-987b-503d70fc6417-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-006a57-d82pq\" (UID: \"fb2a4a17-a7f9-452a-987b-503d70fc6417\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq"
Jul 13 21:49:15.777981 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.777947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2a4a17-a7f9-452a-987b-503d70fc6417-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-006a57-d82pq\" (UID: \"fb2a4a17-a7f9-452a-987b-503d70fc6417\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq"
Jul 13 21:49:15.778608 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.778590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2a4a17-a7f9-452a-987b-503d70fc6417-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-006a57-d82pq\" (UID: \"fb2a4a17-a7f9-452a-987b-503d70fc6417\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq"
Jul 13 21:49:15.925808 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:15.925783    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq"
Jul 13 21:49:16.063117 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:16.063089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq"]
Jul 13 21:49:16.065237 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:49:16.065211    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2a4a17_a7f9_452a_987b_503d70fc6417.slice/crio-734179e1a54979fb0e3e20d6b684d98d37ddb1c063c0b044b988a6de1d639dc0 WatchSource:0}: Error finding container 734179e1a54979fb0e3e20d6b684d98d37ddb1c063c0b044b988a6de1d639dc0: Status 404 returned error can't find the container with id 734179e1a54979fb0e3e20d6b684d98d37ddb1c063c0b044b988a6de1d639dc0
Jul 13 21:49:16.067519 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:16.067502    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:49:16.194655 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:16.194575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq" event={"ID":"fb2a4a17-a7f9-452a-987b-503d70fc6417","Type":"ContainerStarted","Data":"734179e1a54979fb0e3e20d6b684d98d37ddb1c063c0b044b988a6de1d639dc0"}
Jul 13 21:49:16.907678 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:16.907653    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:49:16.915478 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:16.915458    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:49:20.223709 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:20.223677    2580 generic.go:356] "Generic (PLEG): container finished" podID="fb2a4a17-a7f9-452a-987b-503d70fc6417" containerID="6f221b32708a7c9f343d288d852866c8c4c0a684e635299f37872cee2203544e" exitCode=0
Jul 13 21:49:20.224132 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:20.223756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq" event={"ID":"fb2a4a17-a7f9-452a-987b-503d70fc6417","Type":"ContainerDied","Data":"6f221b32708a7c9f343d288d852866c8c4c0a684e635299f37872cee2203544e"}
Jul 13 21:49:21.369426 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:21.369399    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq"
Jul 13 21:49:21.429446 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:21.429416    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2a4a17-a7f9-452a-987b-503d70fc6417-maas-api-service-ca\") pod \"fb2a4a17-a7f9-452a-987b-503d70fc6417\" (UID: \"fb2a4a17-a7f9-452a-987b-503d70fc6417\") "
Jul 13 21:49:21.429813 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:21.429793    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb2a4a17-a7f9-452a-987b-503d70fc6417-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fb2a4a17-a7f9-452a-987b-503d70fc6417" (UID: "fb2a4a17-a7f9-452a-987b-503d70fc6417"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:49:21.530664 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:21.530581    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2a4a17-a7f9-452a-987b-503d70fc6417-maas-api-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:49:22.236230 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:22.236199    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq"
Jul 13 21:49:22.236230 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:22.236210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-006a57-d82pq" event={"ID":"fb2a4a17-a7f9-452a-987b-503d70fc6417","Type":"ContainerDied","Data":"734179e1a54979fb0e3e20d6b684d98d37ddb1c063c0b044b988a6de1d639dc0"}
Jul 13 21:49:22.236464 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:22.236252    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="734179e1a54979fb0e3e20d6b684d98d37ddb1c063c0b044b988a6de1d639dc0"
Jul 13 21:49:29.163354 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:29.163317    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:49:51.059514 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:49:51.059425    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:50:03.059151 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:03.059116    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:50:06.956829 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:06.956791    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"]
Jul 13 21:50:06.957440 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:06.957421    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb2a4a17-a7f9-452a-987b-503d70fc6417" containerName="revoke-keys"
Jul 13 21:50:06.957521 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:06.957444    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb2a4a17-a7f9-452a-987b-503d70fc6417" containerName="revoke-keys"
Jul 13 21:50:06.957580 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:06.957530    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb2a4a17-a7f9-452a-987b-503d70fc6417" containerName="revoke-keys"
Jul 13 21:50:06.959834 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:06.959814    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:06.962120 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:06.962100    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8e2974\"/\"openshift-service-ca.crt\""
Jul 13 21:50:06.962944 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:06.962927    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8e2974\"/\"default-dockercfg-9p8g5\""
Jul 13 21:50:06.963049 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:06.962929    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8e2974\"/\"kube-root-ca.crt\""
Jul 13 21:50:06.963049 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:06.962957    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8e2974\"/\"auth-test-model-8e2974-kserve-self-signed-certs\""
Jul 13 21:50:06.969016 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:06.968995    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"]
Jul 13 21:50:07.060438 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.060376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-home\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.060615 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.060566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-dshm\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.060615 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.060603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-tmp-dir\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.060718 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.060635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-model-cache\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.060718 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.060652    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-225cb\" (UniqueName: \"kubernetes.io/projected/955386eb-2c72-4cb6-8a97-eb957e950a2c-kube-api-access-225cb\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.060794 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.060712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/955386eb-2c72-4cb6-8a97-eb957e950a2c-tls-certs\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.161221 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.161185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-dshm\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.161221 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.161225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-tmp-dir\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.161513 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.161251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-model-cache\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.161513 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.161274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-225cb\" (UniqueName: \"kubernetes.io/projected/955386eb-2c72-4cb6-8a97-eb957e950a2c-kube-api-access-225cb\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.161513 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.161318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/955386eb-2c72-4cb6-8a97-eb957e950a2c-tls-certs\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.161513 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.161356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-home\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.161737 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.161716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-tmp-dir\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.161792 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.161751    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-model-cache\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.161792 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.161776    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-home\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.163506 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.163486    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-dshm\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.163876 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.163853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/955386eb-2c72-4cb6-8a97-eb957e950a2c-tls-certs\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.168485 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.168462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-225cb\" (UniqueName: \"kubernetes.io/projected/955386eb-2c72-4cb6-8a97-eb957e950a2c-kube-api-access-225cb\") pod \"auth-test-model-8e2974-kserve-b4b5d5487-9xxqm\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") " pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.270631 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.270556    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:07.412519 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.412486    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"]
Jul 13 21:50:07.413712 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:50:07.413681    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod955386eb_2c72_4cb6_8a97_eb957e950a2c.slice/crio-a45eccba155c3d92e099805b1c90747fccde0b3b774fb6225c7139fa849a6b21 WatchSource:0}: Error finding container a45eccba155c3d92e099805b1c90747fccde0b3b774fb6225c7139fa849a6b21: Status 404 returned error can't find the container with id a45eccba155c3d92e099805b1c90747fccde0b3b774fb6225c7139fa849a6b21
Jul 13 21:50:07.514558 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.514512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm" event={"ID":"955386eb-2c72-4cb6-8a97-eb957e950a2c","Type":"ContainerStarted","Data":"7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619"}
Jul 13 21:50:07.514731 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.514571    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm" event={"ID":"955386eb-2c72-4cb6-8a97-eb957e950a2c","Type":"ContainerStarted","Data":"a45eccba155c3d92e099805b1c90747fccde0b3b774fb6225c7139fa849a6b21"}
Jul 13 21:50:07.531765 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:07.531670    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm" podStartSLOduration=1.5316556829999999 podStartE2EDuration="1.531655683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:50:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:50:07.529325685 +0000 UTC m=+2451.384470569" watchObservedRunningTime="2026-07-13 21:50:07.531655683 +0000 UTC m=+2451.386800564"
Jul 13 21:50:13.056031 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:13.055993    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:50:17.270984 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:17.270954    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:17.271407 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:17.271036    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:17.283407 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:17.283356    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:17.583567 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:17.583472    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:50:32.365100 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.365066    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"]
Jul 13 21:50:32.368044 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.368020    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.370089 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.370067    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-884921\"/\"kube-root-ca.crt\""
Jul 13 21:50:32.370823 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.370801    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-884921\"/\"default-dockercfg-5zm2g\""
Jul 13 21:50:32.370937 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.370801    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-884921\"/\"auth-test-model-884921-kserve-self-signed-certs\""
Jul 13 21:50:32.370937 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.370833    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-884921\"/\"openshift-service-ca.crt\""
Jul 13 21:50:32.377571 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.377546    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"]
Jul 13 21:50:32.399308 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.399276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92zn5\" (UniqueName: \"kubernetes.io/projected/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-kube-api-access-92zn5\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.399447 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.399314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-tls-certs\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.399495 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.399469    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-model-cache\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.399533 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.399506    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-home\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.399580 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.399535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-dshm\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.399580 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.399555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-tmp-dir\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.500863 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.500818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-model-cache\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.501053 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.500871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-home\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.501053 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.500906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-dshm\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.501053 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.500930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-tmp-dir\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.501053 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.500984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92zn5\" (UniqueName: \"kubernetes.io/projected/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-kube-api-access-92zn5\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.501053 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.501008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-tls-certs\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.501331 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.501218    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-model-cache\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.501331 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.501289    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-home\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.501515 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.501363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-tmp-dir\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.503376 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.503353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-dshm\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.503612 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.503590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-tls-certs\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.508377 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.508351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92zn5\" (UniqueName: \"kubernetes.io/projected/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-kube-api-access-92zn5\") pod \"auth-test-model-884921-kserve-6655f98c79-4484q\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") " pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.679775 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.679745    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:32.823118 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:32.823089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"]
Jul 13 21:50:32.824089 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:50:32.824060    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1857052c_6bbc_4dcd_bfca_5aaed8ebe8f0.slice/crio-6acdcd70465d678da680cf2fb95dbe3e949021a221b9f37bcaad70fbe8de3497 WatchSource:0}: Error finding container 6acdcd70465d678da680cf2fb95dbe3e949021a221b9f37bcaad70fbe8de3497: Status 404 returned error can't find the container with id 6acdcd70465d678da680cf2fb95dbe3e949021a221b9f37bcaad70fbe8de3497
Jul 13 21:50:33.663603 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:33.663567    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q" event={"ID":"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0","Type":"ContainerStarted","Data":"d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8"}
Jul 13 21:50:33.663966 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:33.663613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q" event={"ID":"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0","Type":"ContainerStarted","Data":"6acdcd70465d678da680cf2fb95dbe3e949021a221b9f37bcaad70fbe8de3497"}
Jul 13 21:50:33.680805 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:33.680756    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q" podStartSLOduration=1.6807421009999999 podStartE2EDuration="1.680742101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:50:33.677807357 +0000 UTC m=+2477.532952238" watchObservedRunningTime="2026-07-13 21:50:33.680742101 +0000 UTC m=+2477.535886982"
Jul 13 21:50:36.263461 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:36.263428    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:50:42.680399 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:42.680346    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:42.680821 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:42.680678    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:42.693094 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:42.693072    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:42.725459 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:42.725432    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:50:49.064172 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:50:49.064129    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:51:07.269087 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:51:07.269052    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:51:25.158632 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:51:25.158549    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:51:39.468872 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:51:39.468834    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:51:58.454199 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:51:58.454154    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:52:15.662603 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:15.662568    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:52:32.669455 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:32.669403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:52:36.934689 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:36.934655    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"]
Jul 13 21:52:37.853262 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:37.853227    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"]
Jul 13 21:52:48.864729 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:48.864691    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:52:51.955204 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:51.955155    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm" podUID="955386eb-2c72-4cb6-8a97-eb957e950a2c" containerName="main" containerID="cri-o://7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619" gracePeriod=45
Jul 13 21:52:52.219634 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.219578    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:52:52.359663 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.359633    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-dshm\") pod \"955386eb-2c72-4cb6-8a97-eb957e950a2c\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") "
Jul 13 21:52:52.359826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.359682    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/955386eb-2c72-4cb6-8a97-eb957e950a2c-tls-certs\") pod \"955386eb-2c72-4cb6-8a97-eb957e950a2c\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") "
Jul 13 21:52:52.359826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.359724    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-tmp-dir\") pod \"955386eb-2c72-4cb6-8a97-eb957e950a2c\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") "
Jul 13 21:52:52.359826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.359744    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-home\") pod \"955386eb-2c72-4cb6-8a97-eb957e950a2c\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") "
Jul 13 21:52:52.359826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.359767    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-225cb\" (UniqueName: \"kubernetes.io/projected/955386eb-2c72-4cb6-8a97-eb957e950a2c-kube-api-access-225cb\") pod \"955386eb-2c72-4cb6-8a97-eb957e950a2c\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") "
Jul 13 21:52:52.359826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.359802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-model-cache\") pod \"955386eb-2c72-4cb6-8a97-eb957e950a2c\" (UID: \"955386eb-2c72-4cb6-8a97-eb957e950a2c\") "
Jul 13 21:52:52.360087 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.359969    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "955386eb-2c72-4cb6-8a97-eb957e950a2c" (UID: "955386eb-2c72-4cb6-8a97-eb957e950a2c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:52:52.360087 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.360049    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-home" (OuterVolumeSpecName: "home") pod "955386eb-2c72-4cb6-8a97-eb957e950a2c" (UID: "955386eb-2c72-4cb6-8a97-eb957e950a2c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:52:52.360206 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.360161    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-model-cache" (OuterVolumeSpecName: "model-cache") pod "955386eb-2c72-4cb6-8a97-eb957e950a2c" (UID: "955386eb-2c72-4cb6-8a97-eb957e950a2c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:52:52.360252 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.360218    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-tmp-dir\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:52:52.360252 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.360230    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-home\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:52:52.362031 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.361993    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-dshm" (OuterVolumeSpecName: "dshm") pod "955386eb-2c72-4cb6-8a97-eb957e950a2c" (UID: "955386eb-2c72-4cb6-8a97-eb957e950a2c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:52:52.362031 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.362020    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/955386eb-2c72-4cb6-8a97-eb957e950a2c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "955386eb-2c72-4cb6-8a97-eb957e950a2c" (UID: "955386eb-2c72-4cb6-8a97-eb957e950a2c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:52:52.362186 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.362034    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/955386eb-2c72-4cb6-8a97-eb957e950a2c-kube-api-access-225cb" (OuterVolumeSpecName: "kube-api-access-225cb") pod "955386eb-2c72-4cb6-8a97-eb957e950a2c" (UID: "955386eb-2c72-4cb6-8a97-eb957e950a2c"). InnerVolumeSpecName "kube-api-access-225cb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:52:52.461288 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.461251    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-dshm\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:52:52.461288 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.461283    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/955386eb-2c72-4cb6-8a97-eb957e950a2c-tls-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:52:52.461510 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.461299    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-225cb\" (UniqueName: \"kubernetes.io/projected/955386eb-2c72-4cb6-8a97-eb957e950a2c-kube-api-access-225cb\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:52:52.461510 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.461312    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/955386eb-2c72-4cb6-8a97-eb957e950a2c-model-cache\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:52:52.476563 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.476489    2580 generic.go:356] "Generic (PLEG): container finished" podID="955386eb-2c72-4cb6-8a97-eb957e950a2c" containerID="7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619" exitCode=0
Jul 13 21:52:52.476563 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.476540    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"
Jul 13 21:52:52.476715 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.476574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm" event={"ID":"955386eb-2c72-4cb6-8a97-eb957e950a2c","Type":"ContainerDied","Data":"7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619"}
Jul 13 21:52:52.476715 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.476624    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm" event={"ID":"955386eb-2c72-4cb6-8a97-eb957e950a2c","Type":"ContainerDied","Data":"a45eccba155c3d92e099805b1c90747fccde0b3b774fb6225c7139fa849a6b21"}
Jul 13 21:52:52.476715 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.476646    2580 scope.go:117] "RemoveContainer" containerID="7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619"
Jul 13 21:52:52.488923 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.488903    2580 scope.go:117] "RemoveContainer" containerID="7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619"
Jul 13 21:52:52.489354 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:52:52.489329    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619\": container with ID starting with 7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619 not found: ID does not exist" containerID="7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619"
Jul 13 21:52:52.489463 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.489367    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619"} err="failed to get container status \"7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619\": rpc error: code = NotFound desc = could not find container \"7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619\": container with ID starting with 7e2f4cabe04bf730f313f315c3e62b5ff308a7b4a303dfaa629b75d2c80e4619 not found: ID does not exist"
Jul 13 21:52:52.499440 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.499415    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"]
Jul 13 21:52:52.503098 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.503077    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/auth-test-model-8e2974-kserve-b4b5d5487-9xxqm"]
Jul 13 21:52:52.718132 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.718090    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="955386eb-2c72-4cb6-8a97-eb957e950a2c" path="/var/lib/kubelet/pods/955386eb-2c72-4cb6-8a97-eb957e950a2c/volumes"
Jul 13 21:52:52.874288 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:52.874207    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q" podUID="1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0" containerName="main" containerID="cri-o://d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8" gracePeriod=45
Jul 13 21:52:53.126882 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.126824    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:52:53.269015 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.268987    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92zn5\" (UniqueName: \"kubernetes.io/projected/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-kube-api-access-92zn5\") pod \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") "
Jul 13 21:52:53.269189 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.269047    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-tmp-dir\") pod \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") "
Jul 13 21:52:53.269246 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.269224    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-dshm\") pod \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") "
Jul 13 21:52:53.269285 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.269274    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-tls-certs\") pod \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") "
Jul 13 21:52:53.269433 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.269281    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0" (UID: "1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:52:53.269433 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.269321    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-home\") pod \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") "
Jul 13 21:52:53.269433 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.269371    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-model-cache\") pod \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\" (UID: \"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0\") "
Jul 13 21:52:53.269644 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.269622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-home" (OuterVolumeSpecName: "home") pod "1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0" (UID: "1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:52:53.269644 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.269629    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0" (UID: "1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:52:53.269782 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.269765    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-home\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:52:53.269836 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.269783    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-model-cache\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:52:53.269836 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.269794    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-tmp-dir\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:52:53.271340 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.271307    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-kube-api-access-92zn5" (OuterVolumeSpecName: "kube-api-access-92zn5") pod "1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0" (UID: "1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0"). InnerVolumeSpecName "kube-api-access-92zn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:52:53.271465 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.271423    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0" (UID: "1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:52:53.271531 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.271483    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-dshm" (OuterVolumeSpecName: "dshm") pod "1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0" (UID: "1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:52:53.370897 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.370852    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92zn5\" (UniqueName: \"kubernetes.io/projected/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-kube-api-access-92zn5\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:52:53.370897 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.370891    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-dshm\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:52:53.370897 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.370902    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0-tls-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:52:53.484350 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.484315    2580 generic.go:356] "Generic (PLEG): container finished" podID="1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0" containerID="d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8" exitCode=0
Jul 13 21:52:53.484542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.484362    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"
Jul 13 21:52:53.484542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.484410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q" event={"ID":"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0","Type":"ContainerDied","Data":"d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8"}
Jul 13 21:52:53.484542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.484452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q" event={"ID":"1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0","Type":"ContainerDied","Data":"6acdcd70465d678da680cf2fb95dbe3e949021a221b9f37bcaad70fbe8de3497"}
Jul 13 21:52:53.484542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.484477    2580 scope.go:117] "RemoveContainer" containerID="d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8"
Jul 13 21:52:53.494424 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.494405    2580 scope.go:117] "RemoveContainer" containerID="d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8"
Jul 13 21:52:53.494677 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:52:53.494657    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8\": container with ID starting with d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8 not found: ID does not exist" containerID="d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8"
Jul 13 21:52:53.494756 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.494688    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8"} err="failed to get container status \"d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8\": rpc error: code = NotFound desc = could not find container \"d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8\": container with ID starting with d21772c8a7269a02d05f51442f1e903f191adf5aaac11f1683f9523a131934c8 not found: ID does not exist"
Jul 13 21:52:53.507635 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.507592    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"]
Jul 13 21:52:53.511792 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:53.511766    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-884921/auth-test-model-884921-kserve-6655f98c79-4484q"]
Jul 13 21:52:54.716986 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:52:54.716952    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0" path="/var/lib/kubelet/pods/1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0/volumes"
Jul 13 21:53:07.858879 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.858843    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"]
Jul 13 21:53:07.859283 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.859270    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="955386eb-2c72-4cb6-8a97-eb957e950a2c" containerName="main"
Jul 13 21:53:07.859333 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.859284    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="955386eb-2c72-4cb6-8a97-eb957e950a2c" containerName="main"
Jul 13 21:53:07.859333 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.859295    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0" containerName="main"
Jul 13 21:53:07.859333 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.859300    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0" containerName="main"
Jul 13 21:53:07.859474 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.859365    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="955386eb-2c72-4cb6-8a97-eb957e950a2c" containerName="main"
Jul 13 21:53:07.859474 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.859372    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1857052c-6bbc-4dcd-bfca-5aaed8ebe8f0" containerName="main"
Jul 13 21:53:07.861624 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.861608    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:07.864632 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.864608    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-884921\"/\"openshift-service-ca.crt\""
Jul 13 21:53:07.864759 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.864658    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-884921\"/\"kube-root-ca.crt\""
Jul 13 21:53:07.864759 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.864680    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-884921\"/\"default-dockercfg-5zm2g\""
Jul 13 21:53:07.864939 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.864689    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-884921\"/\"sub-test-model-884921-kserve-self-signed-certs\""
Jul 13 21:53:07.872261 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.872236    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"]
Jul 13 21:53:07.898858 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.898834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-tmp-dir\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:07.898981 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.898862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-home\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:07.898981 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.898887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-model-cache\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:07.898981 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.898910    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpdmm\" (UniqueName: \"kubernetes.io/projected/ec685951-b39d-4c37-a658-e5b30f6004c1-kube-api-access-xpdmm\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:07.899142 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.899007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-dshm\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:07.899142 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.899059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec685951-b39d-4c37-a658-e5b30f6004c1-tls-certs\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:07.999791 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.999758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-dshm\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:07.999791 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.999799    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec685951-b39d-4c37-a658-e5b30f6004c1-tls-certs\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:08.000023 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.999866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-tmp-dir\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:08.000023 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.999884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-home\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:08.000023 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.999902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-model-cache\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:08.000023 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:07.999937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdmm\" (UniqueName: \"kubernetes.io/projected/ec685951-b39d-4c37-a658-e5b30f6004c1-kube-api-access-xpdmm\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:08.000272 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:08.000244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-home\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:08.000332 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:08.000292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-model-cache\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:08.000332 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:08.000304    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-tmp-dir\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:08.002099 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:08.002078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-dshm\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:08.002423 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:08.002372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec685951-b39d-4c37-a658-e5b30f6004c1-tls-certs\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:08.006808 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:08.006788    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpdmm\" (UniqueName: \"kubernetes.io/projected/ec685951-b39d-4c37-a658-e5b30f6004c1-kube-api-access-xpdmm\") pod \"sub-test-model-884921-kserve-7dbfb778c5-tt274\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") " pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:08.172527 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:08.172493    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:08.309775 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:08.309741    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"]
Jul 13 21:53:08.310950 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:53:08.310924    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec685951_b39d_4c37_a658_e5b30f6004c1.slice/crio-ee2b936caee6ace4fa8ee60ebc2c5eb991afc054e963a302583c9cb4c23cc3fb WatchSource:0}: Error finding container ee2b936caee6ace4fa8ee60ebc2c5eb991afc054e963a302583c9cb4c23cc3fb: Status 404 returned error can't find the container with id ee2b936caee6ace4fa8ee60ebc2c5eb991afc054e963a302583c9cb4c23cc3fb
Jul 13 21:53:08.575552 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:08.575465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274" event={"ID":"ec685951-b39d-4c37-a658-e5b30f6004c1","Type":"ContainerStarted","Data":"8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1"}
Jul 13 21:53:08.575552 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:08.575506    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274" event={"ID":"ec685951-b39d-4c37-a658-e5b30f6004c1","Type":"ContainerStarted","Data":"ee2b936caee6ace4fa8ee60ebc2c5eb991afc054e963a302583c9cb4c23cc3fb"}
Jul 13 21:53:08.596523 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:08.596470    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274" podStartSLOduration=1.5964553449999999 podStartE2EDuration="1.596455345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:53:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:53:08.594096996 +0000 UTC m=+2632.449241878" watchObservedRunningTime="2026-07-13 21:53:08.596455345 +0000 UTC m=+2632.451600566"
Jul 13 21:53:12.961557 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:12.961514    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:53:18.172757 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:18.172718    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:18.173235 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:18.172771    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:18.185134 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:18.185108    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:18.649892 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:18.649864    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:37.954579 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:37.954541    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:53:43.833677 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:43.833646    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"]
Jul 13 21:53:46.363827 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.363794    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"]
Jul 13 21:53:46.366335 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.366312    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.368592 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.368571    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8e2974\"/\"kube-root-ca.crt\""
Jul 13 21:53:46.369347 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.369326    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8e2974\"/\"openshift-service-ca.crt\""
Jul 13 21:53:46.369517 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.369489    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8e2974\"/\"rate-test-model-8e2974-kserve-self-signed-certs\""
Jul 13 21:53:46.369645 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.369445    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8e2974\"/\"default-dockercfg-9p8g5\""
Jul 13 21:53:46.377490 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.377467    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"]
Jul 13 21:53:46.459094 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.459061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/645abd5c-4627-4a24-982f-a26efe7d95cb-tls-certs\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.459253 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.459110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-home\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.459253 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.459149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-tmp-dir\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.459253 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.459181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd69l\" (UniqueName: \"kubernetes.io/projected/645abd5c-4627-4a24-982f-a26efe7d95cb-kube-api-access-fd69l\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.459253 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.459233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-model-cache\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.459434 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.459295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-dshm\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.560029 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.559991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-model-cache\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.560202 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.560050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-dshm\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.560202 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.560092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/645abd5c-4627-4a24-982f-a26efe7d95cb-tls-certs\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.560202 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.560133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-home\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.560202 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.560151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-tmp-dir\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.560202 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.560177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd69l\" (UniqueName: \"kubernetes.io/projected/645abd5c-4627-4a24-982f-a26efe7d95cb-kube-api-access-fd69l\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.560484 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.560462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-model-cache\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.560575 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.560556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-home\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.560634 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.560577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-tmp-dir\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.562461 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.562433    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-dshm\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.562707 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.562690    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/645abd5c-4627-4a24-982f-a26efe7d95cb-tls-certs\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.567410 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.567372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd69l\" (UniqueName: \"kubernetes.io/projected/645abd5c-4627-4a24-982f-a26efe7d95cb-kube-api-access-fd69l\") pod \"rate-test-model-8e2974-kserve-7c4dd589dc-z825r\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") " pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.677623 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.677590    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:46.820519 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:46.820493    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"]
Jul 13 21:53:46.822924 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:53:46.822899    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod645abd5c_4627_4a24_982f_a26efe7d95cb.slice/crio-3e25e17fbd4be1466a926276ec9af4cb0f504b7c875b55f7edcbd896a97d1f71 WatchSource:0}: Error finding container 3e25e17fbd4be1466a926276ec9af4cb0f504b7c875b55f7edcbd896a97d1f71: Status 404 returned error can't find the container with id 3e25e17fbd4be1466a926276ec9af4cb0f504b7c875b55f7edcbd896a97d1f71
Jul 13 21:53:47.830456 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:47.830416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r" event={"ID":"645abd5c-4627-4a24-982f-a26efe7d95cb","Type":"ContainerStarted","Data":"6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d"}
Jul 13 21:53:47.830869 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:47.830467    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r" event={"ID":"645abd5c-4627-4a24-982f-a26efe7d95cb","Type":"ContainerStarted","Data":"3e25e17fbd4be1466a926276ec9af4cb0f504b7c875b55f7edcbd896a97d1f71"}
Jul 13 21:53:47.847298 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:47.847246    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r" podStartSLOduration=1.84722998 podStartE2EDuration="1.84722998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:53:47.844368852 +0000 UTC m=+2671.699513746" watchObservedRunningTime="2026-07-13 21:53:47.84722998 +0000 UTC m=+2671.702374863"
Jul 13 21:53:56.678197 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:56.678164    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:56.678197 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:56.678204    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:56.690777 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:56.690751    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:56.893244 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:56.893213    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:53:58.162524 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:58.162488    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:53:58.854015 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:58.853951    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274" podUID="ec685951-b39d-4c37-a658-e5b30f6004c1" containerName="main" containerID="cri-o://8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1" gracePeriod=45
Jul 13 21:53:59.119035 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.118969    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:59.173815 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.173774    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-dshm\") pod \"ec685951-b39d-4c37-a658-e5b30f6004c1\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") "
Jul 13 21:53:59.174297 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.173879    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-model-cache\") pod \"ec685951-b39d-4c37-a658-e5b30f6004c1\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") "
Jul 13 21:53:59.174297 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.173919    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-home\") pod \"ec685951-b39d-4c37-a658-e5b30f6004c1\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") "
Jul 13 21:53:59.174297 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.173956    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec685951-b39d-4c37-a658-e5b30f6004c1-tls-certs\") pod \"ec685951-b39d-4c37-a658-e5b30f6004c1\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") "
Jul 13 21:53:59.174297 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.174002    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-tmp-dir\") pod \"ec685951-b39d-4c37-a658-e5b30f6004c1\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") "
Jul 13 21:53:59.174297 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.174051    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpdmm\" (UniqueName: \"kubernetes.io/projected/ec685951-b39d-4c37-a658-e5b30f6004c1-kube-api-access-xpdmm\") pod \"ec685951-b39d-4c37-a658-e5b30f6004c1\" (UID: \"ec685951-b39d-4c37-a658-e5b30f6004c1\") "
Jul 13 21:53:59.174297 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.174155    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-model-cache" (OuterVolumeSpecName: "model-cache") pod "ec685951-b39d-4c37-a658-e5b30f6004c1" (UID: "ec685951-b39d-4c37-a658-e5b30f6004c1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:53:59.174297 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.174223    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-home" (OuterVolumeSpecName: "home") pod "ec685951-b39d-4c37-a658-e5b30f6004c1" (UID: "ec685951-b39d-4c37-a658-e5b30f6004c1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:53:59.174297 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.174263    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ec685951-b39d-4c37-a658-e5b30f6004c1" (UID: "ec685951-b39d-4c37-a658-e5b30f6004c1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:53:59.174698 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.174520    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-model-cache\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:53:59.174698 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.174542    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-home\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:53:59.174698 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.174556    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-tmp-dir\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:53:59.175983 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.175957    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-dshm" (OuterVolumeSpecName: "dshm") pod "ec685951-b39d-4c37-a658-e5b30f6004c1" (UID: "ec685951-b39d-4c37-a658-e5b30f6004c1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:53:59.176261 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.176241    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec685951-b39d-4c37-a658-e5b30f6004c1-kube-api-access-xpdmm" (OuterVolumeSpecName: "kube-api-access-xpdmm") pod "ec685951-b39d-4c37-a658-e5b30f6004c1" (UID: "ec685951-b39d-4c37-a658-e5b30f6004c1"). InnerVolumeSpecName "kube-api-access-xpdmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:53:59.176320 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.176290    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec685951-b39d-4c37-a658-e5b30f6004c1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec685951-b39d-4c37-a658-e5b30f6004c1" (UID: "ec685951-b39d-4c37-a658-e5b30f6004c1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:53:59.275869 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.275836    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec685951-b39d-4c37-a658-e5b30f6004c1-tls-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:53:59.275869 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.275865    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpdmm\" (UniqueName: \"kubernetes.io/projected/ec685951-b39d-4c37-a658-e5b30f6004c1-kube-api-access-xpdmm\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:53:59.275869 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.275876    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec685951-b39d-4c37-a658-e5b30f6004c1-dshm\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:53:59.900266 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.900234    2580 generic.go:356] "Generic (PLEG): container finished" podID="ec685951-b39d-4c37-a658-e5b30f6004c1" containerID="8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1" exitCode=0
Jul 13 21:53:59.900266 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.900274    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"
Jul 13 21:53:59.900586 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.900326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274" event={"ID":"ec685951-b39d-4c37-a658-e5b30f6004c1","Type":"ContainerDied","Data":"8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1"}
Jul 13 21:53:59.900586 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.900369    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274" event={"ID":"ec685951-b39d-4c37-a658-e5b30f6004c1","Type":"ContainerDied","Data":"ee2b936caee6ace4fa8ee60ebc2c5eb991afc054e963a302583c9cb4c23cc3fb"}
Jul 13 21:53:59.900586 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.900419    2580 scope.go:117] "RemoveContainer" containerID="8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1"
Jul 13 21:53:59.912661 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.912639    2580 scope.go:117] "RemoveContainer" containerID="8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1"
Jul 13 21:53:59.912981 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:53:59.912963    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1\": container with ID starting with 8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1 not found: ID does not exist" containerID="8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1"
Jul 13 21:53:59.913024 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.912990    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1"} err="failed to get container status \"8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1\": rpc error: code = NotFound desc = could not find container \"8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1\": container with ID starting with 8eb1a5714bd9f48bc8ed2b025f22f2699881b230e5ce85e0db4a352a64cccbe1 not found: ID does not exist"
Jul 13 21:53:59.921962 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.921934    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"]
Jul 13 21:53:59.925349 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:53:59.925320    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-884921/sub-test-model-884921-kserve-7dbfb778c5-tt274"]
Jul 13 21:54:00.714693 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:00.714657    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec685951-b39d-4c37-a658-e5b30f6004c1" path="/var/lib/kubelet/pods/ec685951-b39d-4c37-a658-e5b30f6004c1/volumes"
Jul 13 21:54:16.947350 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:16.947241    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:54:16.958644 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:16.955715    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l84wn_342572ad-5e24-4e80-88ae-7adbfeb3764b/ovn-acl-logging/0.log"
Jul 13 21:54:31.967078 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.967044    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"]
Jul 13 21:54:31.967572 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.967537    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec685951-b39d-4c37-a658-e5b30f6004c1" containerName="main"
Jul 13 21:54:31.967572 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.967550    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec685951-b39d-4c37-a658-e5b30f6004c1" containerName="main"
Jul 13 21:54:31.967660 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.967625    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec685951-b39d-4c37-a658-e5b30f6004c1" containerName="main"
Jul 13 21:54:31.970862 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.970844    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:31.973476 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.973451    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-884921\"/\"kube-root-ca.crt\""
Jul 13 21:54:31.974251 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.974225    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-884921\"/\"openshift-service-ca.crt\""
Jul 13 21:54:31.974403 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.974364    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-884921\"/\"rate-test-model-884921-kserve-self-signed-certs\""
Jul 13 21:54:31.974497 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.974457    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-884921\"/\"default-dockercfg-5zm2g\""
Jul 13 21:54:31.980738 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.980715    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"]
Jul 13 21:54:31.998976 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.998953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-home\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:31.999092 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.998987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-dshm\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:31.999092 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.999011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-model-cache\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:31.999092 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.999037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvgpw\" (UniqueName: \"kubernetes.io/projected/5e35fd98-0359-43fb-9b14-03616f410571-kube-api-access-qvgpw\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:31.999261 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.999156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-tmp-dir\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:31.999261 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:31.999224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e35fd98-0359-43fb-9b14-03616f410571-tls-certs\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.100582 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.100553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-dshm\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.100751 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.100593    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-model-cache\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.100751 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.100618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvgpw\" (UniqueName: \"kubernetes.io/projected/5e35fd98-0359-43fb-9b14-03616f410571-kube-api-access-qvgpw\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.100751 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.100688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-tmp-dir\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.100751 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.100743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e35fd98-0359-43fb-9b14-03616f410571-tls-certs\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.100925 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.100899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-home\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.101094 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.101069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-model-cache\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.101228 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.101133    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-tmp-dir\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.101285 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.101246    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-home\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.103083 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.103060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-dshm\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.103231 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.103210    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e35fd98-0359-43fb-9b14-03616f410571-tls-certs\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.108350 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.108332    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvgpw\" (UniqueName: \"kubernetes.io/projected/5e35fd98-0359-43fb-9b14-03616f410571-kube-api-access-qvgpw\") pod \"rate-test-model-884921-kserve-65596f5bf9-2vgls\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") " pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.281900 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.281800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:32.423369 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:32.423336    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"]
Jul 13 21:54:32.425266 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:54:32.425229    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e35fd98_0359_43fb_9b14_03616f410571.slice/crio-3e480e42a5baeb90e036d91613075377cfe2f478d034cc63365d1d5d73b9d6db WatchSource:0}: Error finding container 3e480e42a5baeb90e036d91613075377cfe2f478d034cc63365d1d5d73b9d6db: Status 404 returned error can't find the container with id 3e480e42a5baeb90e036d91613075377cfe2f478d034cc63365d1d5d73b9d6db
Jul 13 21:54:33.094550 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:33.094510    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls" event={"ID":"5e35fd98-0359-43fb-9b14-03616f410571","Type":"ContainerStarted","Data":"f9806a4cee070a03af5c6ec46b4742c5211691f10eff771e0bbc5d4b62a43df5"}
Jul 13 21:54:33.094965 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:33.094562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls" event={"ID":"5e35fd98-0359-43fb-9b14-03616f410571","Type":"ContainerStarted","Data":"3e480e42a5baeb90e036d91613075377cfe2f478d034cc63365d1d5d73b9d6db"}
Jul 13 21:54:33.110349 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:33.110293    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls" podStartSLOduration=2.110271582 podStartE2EDuration="2.110271582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:54:33.109763337 +0000 UTC m=+2716.964908244" watchObservedRunningTime="2026-07-13 21:54:33.110271582 +0000 UTC m=+2716.965416467"
Jul 13 21:54:36.865826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:36.865787    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:54:42.282468 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:42.282435    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:42.282967 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:42.282481    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:42.295470 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:42.295443    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:43.173684 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:43.173655    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:54:55.864399 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:54:55.864357    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:55:15.771802 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:15.771755    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:55:23.462598 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:23.462565    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"]
Jul 13 21:55:24.350536 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:24.350502    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"]
Jul 13 21:55:31.058804 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:31.058771    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:55:38.483167 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.483125    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r" podUID="645abd5c-4627-4a24-982f-a26efe7d95cb" containerName="main" containerID="cri-o://6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d" gracePeriod=45
Jul 13 21:55:38.736612 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.736543    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:55:38.858775 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.858737    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-tmp-dir\") pod \"645abd5c-4627-4a24-982f-a26efe7d95cb\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") "
Jul 13 21:55:38.858992 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.858796    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-home\") pod \"645abd5c-4627-4a24-982f-a26efe7d95cb\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") "
Jul 13 21:55:38.858992 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.858829    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd69l\" (UniqueName: \"kubernetes.io/projected/645abd5c-4627-4a24-982f-a26efe7d95cb-kube-api-access-fd69l\") pod \"645abd5c-4627-4a24-982f-a26efe7d95cb\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") "
Jul 13 21:55:38.858992 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.858856    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/645abd5c-4627-4a24-982f-a26efe7d95cb-tls-certs\") pod \"645abd5c-4627-4a24-982f-a26efe7d95cb\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") "
Jul 13 21:55:38.858992 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.858913    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-dshm\") pod \"645abd5c-4627-4a24-982f-a26efe7d95cb\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") "
Jul 13 21:55:38.858992 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.858943    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-model-cache\") pod \"645abd5c-4627-4a24-982f-a26efe7d95cb\" (UID: \"645abd5c-4627-4a24-982f-a26efe7d95cb\") "
Jul 13 21:55:38.859262 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.859142    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "645abd5c-4627-4a24-982f-a26efe7d95cb" (UID: "645abd5c-4627-4a24-982f-a26efe7d95cb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:38.859262 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.859169    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-home" (OuterVolumeSpecName: "home") pod "645abd5c-4627-4a24-982f-a26efe7d95cb" (UID: "645abd5c-4627-4a24-982f-a26efe7d95cb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:38.859367 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.859286    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-model-cache" (OuterVolumeSpecName: "model-cache") pod "645abd5c-4627-4a24-982f-a26efe7d95cb" (UID: "645abd5c-4627-4a24-982f-a26efe7d95cb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:38.859471 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.859414    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-home\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:38.859471 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.859435    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-model-cache\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:38.859471 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.859450    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-tmp-dir\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:38.861043 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.861017    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-dshm" (OuterVolumeSpecName: "dshm") pod "645abd5c-4627-4a24-982f-a26efe7d95cb" (UID: "645abd5c-4627-4a24-982f-a26efe7d95cb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:38.861536 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.861510    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645abd5c-4627-4a24-982f-a26efe7d95cb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "645abd5c-4627-4a24-982f-a26efe7d95cb" (UID: "645abd5c-4627-4a24-982f-a26efe7d95cb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:55:38.861630 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.861544    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/645abd5c-4627-4a24-982f-a26efe7d95cb-kube-api-access-fd69l" (OuterVolumeSpecName: "kube-api-access-fd69l") pod "645abd5c-4627-4a24-982f-a26efe7d95cb" (UID: "645abd5c-4627-4a24-982f-a26efe7d95cb"). InnerVolumeSpecName "kube-api-access-fd69l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:55:38.960262 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.960221    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd69l\" (UniqueName: \"kubernetes.io/projected/645abd5c-4627-4a24-982f-a26efe7d95cb-kube-api-access-fd69l\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:38.960262 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.960255    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/645abd5c-4627-4a24-982f-a26efe7d95cb-tls-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:38.960262 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:38.960267    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/645abd5c-4627-4a24-982f-a26efe7d95cb-dshm\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:39.371733 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.371692    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls" podUID="5e35fd98-0359-43fb-9b14-03616f410571" containerName="main" containerID="cri-o://f9806a4cee070a03af5c6ec46b4742c5211691f10eff771e0bbc5d4b62a43df5" gracePeriod=45
Jul 13 21:55:39.507957 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.507925    2580 generic.go:356] "Generic (PLEG): container finished" podID="645abd5c-4627-4a24-982f-a26efe7d95cb" containerID="6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d" exitCode=0
Jul 13 21:55:39.508355 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.507981    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"
Jul 13 21:55:39.508355 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.508005    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r" event={"ID":"645abd5c-4627-4a24-982f-a26efe7d95cb","Type":"ContainerDied","Data":"6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d"}
Jul 13 21:55:39.508355 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.508051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r" event={"ID":"645abd5c-4627-4a24-982f-a26efe7d95cb","Type":"ContainerDied","Data":"3e25e17fbd4be1466a926276ec9af4cb0f504b7c875b55f7edcbd896a97d1f71"}
Jul 13 21:55:39.508355 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.508075    2580 scope.go:117] "RemoveContainer" containerID="6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d"
Jul 13 21:55:39.510195 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.510163    2580 generic.go:356] "Generic (PLEG): container finished" podID="5e35fd98-0359-43fb-9b14-03616f410571" containerID="f9806a4cee070a03af5c6ec46b4742c5211691f10eff771e0bbc5d4b62a43df5" exitCode=0
Jul 13 21:55:39.510305 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.510213    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls" event={"ID":"5e35fd98-0359-43fb-9b14-03616f410571","Type":"ContainerDied","Data":"f9806a4cee070a03af5c6ec46b4742c5211691f10eff771e0bbc5d4b62a43df5"}
Jul 13 21:55:39.521740 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.521717    2580 scope.go:117] "RemoveContainer" containerID="6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d"
Jul 13 21:55:39.522228 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:55:39.522203    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d\": container with ID starting with 6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d not found: ID does not exist" containerID="6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d"
Jul 13 21:55:39.522324 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.522237    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d"} err="failed to get container status \"6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d\": rpc error: code = NotFound desc = could not find container \"6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d\": container with ID starting with 6be7452ccb8f48dfdd3bac91911fec9fcba40d036fc6d1f296bc6b0ebfd77d1d not found: ID does not exist"
Jul 13 21:55:39.535033 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.535001    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"]
Jul 13 21:55:39.538321 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.538298    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/rate-test-model-8e2974-kserve-7c4dd589dc-z825r"]
Jul 13 21:55:39.639916 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.639895    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:55:39.668149 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.668115    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvgpw\" (UniqueName: \"kubernetes.io/projected/5e35fd98-0359-43fb-9b14-03616f410571-kube-api-access-qvgpw\") pod \"5e35fd98-0359-43fb-9b14-03616f410571\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") "
Jul 13 21:55:39.668329 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.668163    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-home\") pod \"5e35fd98-0359-43fb-9b14-03616f410571\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") "
Jul 13 21:55:39.668329 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.668189    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-tmp-dir\") pod \"5e35fd98-0359-43fb-9b14-03616f410571\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") "
Jul 13 21:55:39.668329 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.668247    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-model-cache\") pod \"5e35fd98-0359-43fb-9b14-03616f410571\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") "
Jul 13 21:55:39.668329 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.668293    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-dshm\") pod \"5e35fd98-0359-43fb-9b14-03616f410571\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") "
Jul 13 21:55:39.668329 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.668330    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e35fd98-0359-43fb-9b14-03616f410571-tls-certs\") pod \"5e35fd98-0359-43fb-9b14-03616f410571\" (UID: \"5e35fd98-0359-43fb-9b14-03616f410571\") "
Jul 13 21:55:39.668644 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.668502    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-home" (OuterVolumeSpecName: "home") pod "5e35fd98-0359-43fb-9b14-03616f410571" (UID: "5e35fd98-0359-43fb-9b14-03616f410571"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:39.668644 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.668556    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5e35fd98-0359-43fb-9b14-03616f410571" (UID: "5e35fd98-0359-43fb-9b14-03616f410571"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:39.668644 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.668601    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-model-cache" (OuterVolumeSpecName: "model-cache") pod "5e35fd98-0359-43fb-9b14-03616f410571" (UID: "5e35fd98-0359-43fb-9b14-03616f410571"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:39.668807 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.668788    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-model-cache\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:39.668867 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.668807    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-home\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:39.668867 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.668823    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-tmp-dir\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:39.670615 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.670592    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e35fd98-0359-43fb-9b14-03616f410571-kube-api-access-qvgpw" (OuterVolumeSpecName: "kube-api-access-qvgpw") pod "5e35fd98-0359-43fb-9b14-03616f410571" (UID: "5e35fd98-0359-43fb-9b14-03616f410571"). InnerVolumeSpecName "kube-api-access-qvgpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:55:39.670735 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.670699    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e35fd98-0359-43fb-9b14-03616f410571-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5e35fd98-0359-43fb-9b14-03616f410571" (UID: "5e35fd98-0359-43fb-9b14-03616f410571"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:55:39.670858 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.670835    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-dshm" (OuterVolumeSpecName: "dshm") pod "5e35fd98-0359-43fb-9b14-03616f410571" (UID: "5e35fd98-0359-43fb-9b14-03616f410571"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:39.769731 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.769693    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e35fd98-0359-43fb-9b14-03616f410571-dshm\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:39.769731 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.769730    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e35fd98-0359-43fb-9b14-03616f410571-tls-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:39.769941 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:39.769747    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvgpw\" (UniqueName: \"kubernetes.io/projected/5e35fd98-0359-43fb-9b14-03616f410571-kube-api-access-qvgpw\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:40.497061 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.497026    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7630-140045777720352"]
Jul 13 21:55:40.497489 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.497476    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="645abd5c-4627-4a24-982f-a26efe7d95cb" containerName="main"
Jul 13 21:55:40.497542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.497490    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="645abd5c-4627-4a24-982f-a26efe7d95cb" containerName="main"
Jul 13 21:55:40.497542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.497498    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e35fd98-0359-43fb-9b14-03616f410571" containerName="main"
Jul 13 21:55:40.497542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.497504    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e35fd98-0359-43fb-9b14-03616f410571" containerName="main"
Jul 13 21:55:40.497639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.497571    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="645abd5c-4627-4a24-982f-a26efe7d95cb" containerName="main"
Jul 13 21:55:40.497639 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.497583    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e35fd98-0359-43fb-9b14-03616f410571" containerName="main"
Jul 13 21:55:40.500885 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.500870    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777720352"
Jul 13 21:55:40.503189 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.503162    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bljmr\""
Jul 13 21:55:40.506548 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.506520    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140045777720352"]
Jul 13 21:55:40.519648 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.519624    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"
Jul 13 21:55:40.519648 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.519631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls" event={"ID":"5e35fd98-0359-43fb-9b14-03616f410571","Type":"ContainerDied","Data":"3e480e42a5baeb90e036d91613075377cfe2f478d034cc63365d1d5d73b9d6db"}
Jul 13 21:55:40.520057 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.519681    2580 scope.go:117] "RemoveContainer" containerID="f9806a4cee070a03af5c6ec46b4742c5211691f10eff771e0bbc5d4b62a43df5"
Jul 13 21:55:40.543962 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.543936    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"]
Jul 13 21:55:40.546882 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.546857    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-884921/rate-test-model-884921-kserve-65596f5bf9-2vgls"]
Jul 13 21:55:40.574826 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.574800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7m96\" (UniqueName: \"kubernetes.io/projected/c5d46e86-2ea9-4911-adf1-abd4ca02c917-kube-api-access-g7m96\") pod \"test-curl-7630-140045777720352\" (UID: \"c5d46e86-2ea9-4911-adf1-abd4ca02c917\") " pod="opendatahub/test-curl-7630-140045777720352"
Jul 13 21:55:40.676224 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.676190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7m96\" (UniqueName: \"kubernetes.io/projected/c5d46e86-2ea9-4911-adf1-abd4ca02c917-kube-api-access-g7m96\") pod \"test-curl-7630-140045777720352\" (UID: \"c5d46e86-2ea9-4911-adf1-abd4ca02c917\") " pod="opendatahub/test-curl-7630-140045777720352"
Jul 13 21:55:40.684208 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.684184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7m96\" (UniqueName: \"kubernetes.io/projected/c5d46e86-2ea9-4911-adf1-abd4ca02c917-kube-api-access-g7m96\") pod \"test-curl-7630-140045777720352\" (UID: \"c5d46e86-2ea9-4911-adf1-abd4ca02c917\") " pod="opendatahub/test-curl-7630-140045777720352"
Jul 13 21:55:40.725086 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.725044    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e35fd98-0359-43fb-9b14-03616f410571" path="/var/lib/kubelet/pods/5e35fd98-0359-43fb-9b14-03616f410571/volumes"
Jul 13 21:55:40.725813 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.725785    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="645abd5c-4627-4a24-982f-a26efe7d95cb" path="/var/lib/kubelet/pods/645abd5c-4627-4a24-982f-a26efe7d95cb/volumes"
Jul 13 21:55:40.815951 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.815877    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777720352"
Jul 13 21:55:40.955985 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.955952    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140045777720352"]
Jul 13 21:55:40.957455 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:55:40.957418    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5d46e86_2ea9_4911_adf1_abd4ca02c917.slice/crio-87a7b6f8995b7f4e726bf0aba3430b6bf030f354871bce25c87f24a6a01a38c6 WatchSource:0}: Error finding container 87a7b6f8995b7f4e726bf0aba3430b6bf030f354871bce25c87f24a6a01a38c6: Status 404 returned error can't find the container with id 87a7b6f8995b7f4e726bf0aba3430b6bf030f354871bce25c87f24a6a01a38c6
Jul 13 21:55:40.958664 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:40.958647    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:55:41.527886 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:41.527840    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140045777720352" event={"ID":"c5d46e86-2ea9-4911-adf1-abd4ca02c917","Type":"ContainerStarted","Data":"87a7b6f8995b7f4e726bf0aba3430b6bf030f354871bce25c87f24a6a01a38c6"}
Jul 13 21:55:42.535872 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:42.535836    2580 generic.go:356] "Generic (PLEG): container finished" podID="c5d46e86-2ea9-4911-adf1-abd4ca02c917" containerID="4b404736d5024e2fca582062a18a6bdded6d924c2f96554e9316afd5afdd3b93" exitCode=0
Jul 13 21:55:42.536317 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:42.535924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140045777720352" event={"ID":"c5d46e86-2ea9-4911-adf1-abd4ca02c917","Type":"ContainerDied","Data":"4b404736d5024e2fca582062a18a6bdded6d924c2f96554e9316afd5afdd3b93"}
Jul 13 21:55:43.681286 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:43.681261    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777720352"
Jul 13 21:55:43.697322 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:43.697292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7m96\" (UniqueName: \"kubernetes.io/projected/c5d46e86-2ea9-4911-adf1-abd4ca02c917-kube-api-access-g7m96\") pod \"c5d46e86-2ea9-4911-adf1-abd4ca02c917\" (UID: \"c5d46e86-2ea9-4911-adf1-abd4ca02c917\") "
Jul 13 21:55:43.699510 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:43.699486    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d46e86-2ea9-4911-adf1-abd4ca02c917-kube-api-access-g7m96" (OuterVolumeSpecName: "kube-api-access-g7m96") pod "c5d46e86-2ea9-4911-adf1-abd4ca02c917" (UID: "c5d46e86-2ea9-4911-adf1-abd4ca02c917"). InnerVolumeSpecName "kube-api-access-g7m96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:55:43.716996 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:43.716970    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7630-140045777720352_c5d46e86-2ea9-4911-adf1-abd4ca02c917/test-curl-7630-140045777720352/0.log"
Jul 13 21:55:43.741172 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:43.741148    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7630-140045777720352"]
Jul 13 21:55:43.743547 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:43.743526    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7630-140045777720352"]
Jul 13 21:55:43.798599 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:43.798515    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7m96\" (UniqueName: \"kubernetes.io/projected/c5d46e86-2ea9-4911-adf1-abd4ca02c917-kube-api-access-g7m96\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:55:44.549643 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:44.549607    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777720352"
Jul 13 21:55:44.549643 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:44.549636    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87a7b6f8995b7f4e726bf0aba3430b6bf030f354871bce25c87f24a6a01a38c6"
Jul 13 21:55:44.559496 ip-10-0-128-82 kubenswrapper[2580]: E0713 21:55:44.559462    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7630-140045777720352\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="c5d46e86-2ea9-4911-adf1-abd4ca02c917" pod="opendatahub/test-curl-7630-140045777720352"
Jul 13 21:55:44.714846 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:44.714804    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5d46e86-2ea9-4911-adf1-abd4ca02c917" path="/var/lib/kubelet/pods/c5d46e86-2ea9-4911-adf1-abd4ca02c917/volumes"
Jul 13 21:55:58.257988 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:55:58.257944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:56:10.009134 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.009093    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn"]
Jul 13 21:56:10.009806 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.009556    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d46e86-2ea9-4911-adf1-abd4ca02c917" containerName="test-curl-7630-140045777720352"
Jul 13 21:56:10.009806 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.009569    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d46e86-2ea9-4911-adf1-abd4ca02c917" containerName="test-curl-7630-140045777720352"
Jul 13 21:56:10.009806 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.009647    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5d46e86-2ea9-4911-adf1-abd4ca02c917" containerName="test-curl-7630-140045777720352"
Jul 13 21:56:10.012957 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.012932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn"
Jul 13 21:56:10.015227 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.015200    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:56:10.015443 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.015248    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xxvfz\""
Jul 13 21:56:10.019698 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.019673    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn"]
Jul 13 21:56:10.145191 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.145155    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-884921-bgvcn\" (UID: \"8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn"
Jul 13 21:56:10.246724 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.246690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-884921-bgvcn\" (UID: \"8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn"
Jul 13 21:56:10.247353 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.247331    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-884921-bgvcn\" (UID: \"8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn"
Jul 13 21:56:10.325553 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.325467    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn"
Jul 13 21:56:10.464751 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.464720    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn"]
Jul 13 21:56:10.468361 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:56:10.468333    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b3dbba0_cffd_4a86_bb3a_7173e41fc5dd.slice/crio-d2544a92f33b33576d7d12bfe451956e9285a7e9e7119ab775e5e63e73ab612e WatchSource:0}: Error finding container d2544a92f33b33576d7d12bfe451956e9285a7e9e7119ab775e5e63e73ab612e: Status 404 returned error can't find the container with id d2544a92f33b33576d7d12bfe451956e9285a7e9e7119ab775e5e63e73ab612e
Jul 13 21:56:10.703026 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:10.702972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn" event={"ID":"8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd","Type":"ContainerStarted","Data":"d2544a92f33b33576d7d12bfe451956e9285a7e9e7119ab775e5e63e73ab612e"}
Jul 13 21:56:11.710143 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:11.710104    2580 generic.go:356] "Generic (PLEG): container finished" podID="8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd" containerID="f2ec5fb52c8fed71b2452dc3be8d367d8d2da91857a5673861ef5ffe513f7cbb" exitCode=0
Jul 13 21:56:11.710567 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:11.710186    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn" event={"ID":"8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd","Type":"ContainerDied","Data":"f2ec5fb52c8fed71b2452dc3be8d367d8d2da91857a5673861ef5ffe513f7cbb"}
Jul 13 21:56:12.853977 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:12.853941    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn"
Jul 13 21:56:12.975577 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:12.975484    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd-maas-api-service-ca\") pod \"8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd\" (UID: \"8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd\") "
Jul 13 21:56:12.975851 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:12.975829    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd" (UID: "8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:56:13.076234 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:13.076197    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd-maas-api-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Jul 13 21:56:13.722769 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:13.722740    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn"
Jul 13 21:56:13.722943 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:13.722771    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-884921-bgvcn" event={"ID":"8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd","Type":"ContainerDied","Data":"d2544a92f33b33576d7d12bfe451956e9285a7e9e7119ab775e5e63e73ab612e"}
Jul 13 21:56:13.722943 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:13.722820    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2544a92f33b33576d7d12bfe451956e9285a7e9e7119ab775e5e63e73ab612e"
Jul 13 21:56:24.057265 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:24.057226    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlczj"]
Jul 13 21:56:40.971868 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:40.971832    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v8thl_7283185f-f3c1-4851-a750-8a26199e1870/manager/0.log"
Jul 13 21:56:41.082138 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:41.082104    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8k5t2_e50cfc03-ffa9-4b94-815a-4ad45f2d2736/manager/0.log"
Jul 13 21:56:41.312825 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:41.312739    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zm5t9_9c98b41c-9d63-4b8b-882e-01ba7ad49241/server/0.log"
Jul 13 21:56:41.423769 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:41.423734    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8gm2n_2ce4d85b-8865-4ba9-bbc5-6d73b73485cd/manager/0.log"
Jul 13 21:56:41.779284 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:41.779256    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fb46456c-srrq6_6cd4cba3-f405-4b3a-9364-349061346f19/manager/0.log"
Jul 13 21:56:41.785142 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:41.785122    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fb46456c-srrq6_6cd4cba3-f405-4b3a-9364-349061346f19/copy-manifests/0.log"
Jul 13 21:56:42.806802 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:42.806775    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-006a57-d82pq_fb2a4a17-a7f9-452a-987b-503d70fc6417/revoke-keys/0.log"
Jul 13 21:56:43.683515 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:43.683486    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-884921-bgvcn_8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd/revoke-keys/0.log"
Jul 13 21:56:44.536095 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:44.536066    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm_7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4/pull/0.log"
Jul 13 21:56:44.541852 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:44.541829    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm_7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4/extract/0.log"
Jul 13 21:56:44.547525 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:44.547503    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm_7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4/util/0.log"
Jul 13 21:56:44.656664 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:44.656633    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw_0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51/extract/0.log"
Jul 13 21:56:44.663167 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:44.663148    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw_0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51/util/0.log"
Jul 13 21:56:44.671022 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:44.671003    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw_0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51/pull/0.log"
Jul 13 21:56:44.781210 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:44.781179    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq_ddea4336-870e-4c02-a7e4-288c10d5fbc2/util/0.log"
Jul 13 21:56:44.787115 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:44.787042    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq_ddea4336-870e-4c02-a7e4-288c10d5fbc2/pull/0.log"
Jul 13 21:56:44.795825 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:44.795804    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq_ddea4336-870e-4c02-a7e4-288c10d5fbc2/extract/0.log"
Jul 13 21:56:44.900033 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:44.900005    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v_642421ee-dd9f-41c6-97d2-15566d3063a1/util/0.log"
Jul 13 21:56:44.905856 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:44.905830    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v_642421ee-dd9f-41c6-97d2-15566d3063a1/pull/0.log"
Jul 13 21:56:44.911814 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:44.911781    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v_642421ee-dd9f-41c6-97d2-15566d3063a1/extract/0.log"
Jul 13 21:56:45.138506 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:45.138480    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wfb9b_a792ce73-bf94-411d-b518-9e92821718a2/manager/0.log"
Jul 13 21:56:45.243874 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:45.243848    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-csbrk_f1ff6884-a46d-4504-bacf-7e07148572c7/manager/0.log"
Jul 13 21:56:45.466410 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:45.466312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5fppf_4f121656-0e1e-4fa4-a0e5-25e2a7110e92/registry-server/0.log"
Jul 13 21:56:45.581266 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:45.581237    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xsbvp_9fb1f97d-dd39-454f-90d4-e4fa6e88e51b/manager/0.log"
Jul 13 21:56:45.698939 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:45.698909    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nlczj_55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2/limitador/0.log"
Jul 13 21:56:45.808631 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:45.808550    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lqjp2_e8b2508c-4964-4b6f-a53e-f24a95382549/manager/0.log"
Jul 13 21:56:46.132049 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:46.131961    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678gk47m_a2199ec2-c67c-42c1-a5db-11347291d62c/istio-proxy/0.log"
Jul 13 21:56:46.353397 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:46.353360    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-575f48bc89-nxr4c_aad8d512-d710-4129-b320-e9f95909b9af/kube-auth-proxy/0.log"
Jul 13 21:56:46.578617 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:46.578580    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dgd8s_7a74ec01-192b-49c8-90e2-a8168f8bc7f1/istio-proxy/1.log"
Jul 13 21:56:46.914445 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:46.914415    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85856c9868-5bg85_b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9/router/0.log"
Jul 13 21:56:47.758637 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:47.758601    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-n6rdn_d2ac4ccd-bf07-4262-9e1e-ac748705e8c0/main/0.log"
Jul 13 21:56:51.228705 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.228670    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s2kv7/must-gather-fgflq"]
Jul 13 21:56:51.229110 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.229096    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd" containerName="revoke-keys"
Jul 13 21:56:51.229110 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.229110    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd" containerName="revoke-keys"
Jul 13 21:56:51.229201 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.229192    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b3dbba0-cffd-4a86-bb3a-7173e41fc5dd" containerName="revoke-keys"
Jul 13 21:56:51.232732 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.232712    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2kv7/must-gather-fgflq"
Jul 13 21:56:51.235032 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.235013    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2kv7\"/\"kube-root-ca.crt\""
Jul 13 21:56:51.235486 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.235471    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2kv7\"/\"openshift-service-ca.crt\""
Jul 13 21:56:51.235553 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.235477    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s2kv7\"/\"default-dockercfg-v2jnb\""
Jul 13 21:56:51.243201 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.243179    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2kv7/must-gather-fgflq"]
Jul 13 21:56:51.348406 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.348341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbfxp\" (UniqueName: \"kubernetes.io/projected/0dbcb3e5-2665-4595-987a-222ed1b66d13-kube-api-access-dbfxp\") pod \"must-gather-fgflq\" (UID: \"0dbcb3e5-2665-4595-987a-222ed1b66d13\") " pod="openshift-must-gather-s2kv7/must-gather-fgflq"
Jul 13 21:56:51.348589 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.348420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0dbcb3e5-2665-4595-987a-222ed1b66d13-must-gather-output\") pod \"must-gather-fgflq\" (UID: \"0dbcb3e5-2665-4595-987a-222ed1b66d13\") " pod="openshift-must-gather-s2kv7/must-gather-fgflq"
Jul 13 21:56:51.449146 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.449103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbfxp\" (UniqueName: \"kubernetes.io/projected/0dbcb3e5-2665-4595-987a-222ed1b66d13-kube-api-access-dbfxp\") pod \"must-gather-fgflq\" (UID: \"0dbcb3e5-2665-4595-987a-222ed1b66d13\") " pod="openshift-must-gather-s2kv7/must-gather-fgflq"
Jul 13 21:56:51.449146 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.449155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0dbcb3e5-2665-4595-987a-222ed1b66d13-must-gather-output\") pod \"must-gather-fgflq\" (UID: \"0dbcb3e5-2665-4595-987a-222ed1b66d13\") " pod="openshift-must-gather-s2kv7/must-gather-fgflq"
Jul 13 21:56:51.449576 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.449557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0dbcb3e5-2665-4595-987a-222ed1b66d13-must-gather-output\") pod \"must-gather-fgflq\" (UID: \"0dbcb3e5-2665-4595-987a-222ed1b66d13\") " pod="openshift-must-gather-s2kv7/must-gather-fgflq"
Jul 13 21:56:51.456913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.456892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbfxp\" (UniqueName: \"kubernetes.io/projected/0dbcb3e5-2665-4595-987a-222ed1b66d13-kube-api-access-dbfxp\") pod \"must-gather-fgflq\" (UID: \"0dbcb3e5-2665-4595-987a-222ed1b66d13\") " pod="openshift-must-gather-s2kv7/must-gather-fgflq"
Jul 13 21:56:51.543263 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.543171    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2kv7/must-gather-fgflq"
Jul 13 21:56:51.682724 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.682697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2kv7/must-gather-fgflq"]
Jul 13 21:56:51.685476 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:56:51.685442    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0dbcb3e5_2665_4595_987a_222ed1b66d13.slice/crio-107d37ad77f89d183648e9863fac5584e038204980793a6369521c141063ace4 WatchSource:0}: Error finding container 107d37ad77f89d183648e9863fac5584e038204980793a6369521c141063ace4: Status 404 returned error can't find the container with id 107d37ad77f89d183648e9863fac5584e038204980793a6369521c141063ace4
Jul 13 21:56:51.952231 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:51.952190    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2kv7/must-gather-fgflq" event={"ID":"0dbcb3e5-2665-4595-987a-222ed1b66d13","Type":"ContainerStarted","Data":"107d37ad77f89d183648e9863fac5584e038204980793a6369521c141063ace4"}
Jul 13 21:56:52.963234 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:52.963194    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2kv7/must-gather-fgflq" event={"ID":"0dbcb3e5-2665-4595-987a-222ed1b66d13","Type":"ContainerStarted","Data":"ce90ea0d1eb116e83d869c9c3b1f419c294057535906d2a7acfdd6cd88669e74"}
Jul 13 21:56:52.963657 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:52.963245    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2kv7/must-gather-fgflq" event={"ID":"0dbcb3e5-2665-4595-987a-222ed1b66d13","Type":"ContainerStarted","Data":"f424ba05924ddb3578e3b55d8e51ba6794395bb80d5e74d29d2b6b6a794d0ca5"}
Jul 13 21:56:52.979173 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:52.979120    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s2kv7/must-gather-fgflq" podStartSLOduration=1.228278601 podStartE2EDuration="1.979103147s" totalImagesPullingTime="750.824546ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:56:52.977836762 +0000 UTC m=+2856.832981645" watchObservedRunningTime="2026-07-13 21:56:52.979103147 +0000 UTC m=+2856.834248076"
Jul 13 21:56:53.965430 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:53.965399    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2b859_23ac8fbb-a563-481d-87cc-49188ab19fc4/global-pull-secret-syncer/0.log"
Jul 13 21:56:54.171531 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:54.171495    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xs8jp_662201cc-a8f3-42cc-8ce1-1f9d7d2867bd/konnectivity-agent/0.log"
Jul 13 21:56:54.195008 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:54.194972    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-82.ec2.internal_1d094537333ce6cfa1746d8c5a70fd11/haproxy/0.log"
Jul 13 21:56:58.922426 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:58.922373    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm_7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4/extract/0.log"
Jul 13 21:56:58.949698 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:58.949672    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm_7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4/util/0.log"
Jul 13 21:56:58.975334 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:58.975299    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5nqm_7c8931a2-e5aa-4cc1-b93e-6f72dbc653b4/pull/0.log"
Jul 13 21:56:59.003725 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:59.003682    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw_0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51/extract/0.log"
Jul 13 21:56:59.026616 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:59.026583    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw_0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51/util/0.log"
Jul 13 21:56:59.047913 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:59.047879    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fdplw_0799b09f-1be8-4e0f-b5f5-3cdf3ede4c51/pull/0.log"
Jul 13 21:56:59.073860 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:59.073769    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq_ddea4336-870e-4c02-a7e4-288c10d5fbc2/extract/0.log"
Jul 13 21:56:59.095115 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:59.095089    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq_ddea4336-870e-4c02-a7e4-288c10d5fbc2/util/0.log"
Jul 13 21:56:59.118343 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:59.118312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mr5xq_ddea4336-870e-4c02-a7e4-288c10d5fbc2/pull/0.log"
Jul 13 21:56:59.147869 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:59.147840    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v_642421ee-dd9f-41c6-97d2-15566d3063a1/extract/0.log"
Jul 13 21:56:59.169108 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:59.169074    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v_642421ee-dd9f-41c6-97d2-15566d3063a1/util/0.log"
Jul 13 21:56:59.197562 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:59.197529    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hh8v_642421ee-dd9f-41c6-97d2-15566d3063a1/pull/0.log"
Jul 13 21:56:59.746429 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:59.746398    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wfb9b_a792ce73-bf94-411d-b518-9e92821718a2/manager/0.log"
Jul 13 21:56:59.775697 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:59.775666    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-csbrk_f1ff6884-a46d-4504-bacf-7e07148572c7/manager/0.log"
Jul 13 21:56:59.849827 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:56:59.849775    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5fppf_4f121656-0e1e-4fa4-a0e5-25e2a7110e92/registry-server/0.log"
Jul 13 21:57:00.008875 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:00.008795    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xsbvp_9fb1f97d-dd39-454f-90d4-e4fa6e88e51b/manager/0.log"
Jul 13 21:57:00.030011 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:00.029974    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nlczj_55fd35a8-63ba-4dcb-bb3c-68cd65d5b6d2/limitador/0.log"
Jul 13 21:57:00.133542 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:00.133305    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lqjp2_e8b2508c-4964-4b6f-a53e-f24a95382549/manager/0.log"
Jul 13 21:57:01.741709 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:01.741668    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32432980-45f0-41ba-aeb3-ab6b7e1950cd/alertmanager/0.log"
Jul 13 21:57:01.780180 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:01.780150    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32432980-45f0-41ba-aeb3-ab6b7e1950cd/config-reloader/0.log"
Jul 13 21:57:01.811557 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:01.811520    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32432980-45f0-41ba-aeb3-ab6b7e1950cd/kube-rbac-proxy-web/0.log"
Jul 13 21:57:01.845434 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:01.845358    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32432980-45f0-41ba-aeb3-ab6b7e1950cd/kube-rbac-proxy/0.log"
Jul 13 21:57:01.873853 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:01.873818    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32432980-45f0-41ba-aeb3-ab6b7e1950cd/kube-rbac-proxy-metric/0.log"
Jul 13 21:57:01.904890 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:01.904864    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32432980-45f0-41ba-aeb3-ab6b7e1950cd/prom-label-proxy/0.log"
Jul 13 21:57:01.943698 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:01.943669    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32432980-45f0-41ba-aeb3-ab6b7e1950cd/init-config-reloader/0.log"
Jul 13 21:57:02.030884 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:02.030803    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-cvzz6_a7e4be6a-c380-426f-a6d3-d224bcfa09c1/cluster-monitoring-operator/0.log"
Jul 13 21:57:02.108074 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:02.108031    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-skmnl_14926375-8558-4cd8-a953-afca58bcaf40/kube-state-metrics/0.log"
Jul 13 21:57:02.140790 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:02.140761    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-skmnl_14926375-8558-4cd8-a953-afca58bcaf40/kube-rbac-proxy-main/0.log"
Jul 13 21:57:02.177954 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:02.177923    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-skmnl_14926375-8558-4cd8-a953-afca58bcaf40/kube-rbac-proxy-self/0.log"
Jul 13 21:57:02.220180 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:02.220145    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d4fcd5566-vq7cw_de558037-7e02-41ef-bed8-e7775e8c5604/metrics-server/0.log"
Jul 13 21:57:02.269264 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:02.269237    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-rgv8h_d692f271-582f-4613-9f9d-541ab066c257/monitoring-plugin/0.log"
Jul 13 21:57:02.326720 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:02.326636    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7kts5_65f81efa-d6fb-40dc-9d51-8ad043cf2f72/node-exporter/0.log"
Jul 13 21:57:02.362194 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:02.362157    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7kts5_65f81efa-d6fb-40dc-9d51-8ad043cf2f72/kube-rbac-proxy/0.log"
Jul 13 21:57:02.396926 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:02.396889    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7kts5_65f81efa-d6fb-40dc-9d51-8ad043cf2f72/init-textfile/0.log"
Jul 13 21:57:03.225850 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:03.225822    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ccbdc876f-b4wzz_40d88f3a-7e5f-4e9b-9ee8-e02545caae41/thanos-query/0.log"
Jul 13 21:57:03.247683 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:03.247649    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ccbdc876f-b4wzz_40d88f3a-7e5f-4e9b-9ee8-e02545caae41/kube-rbac-proxy-web/0.log"
Jul 13 21:57:03.268561 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:03.268534    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ccbdc876f-b4wzz_40d88f3a-7e5f-4e9b-9ee8-e02545caae41/kube-rbac-proxy/0.log"
Jul 13 21:57:03.288927 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:03.288895    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ccbdc876f-b4wzz_40d88f3a-7e5f-4e9b-9ee8-e02545caae41/prom-label-proxy/0.log"
Jul 13 21:57:03.309007 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:03.308979    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ccbdc876f-b4wzz_40d88f3a-7e5f-4e9b-9ee8-e02545caae41/kube-rbac-proxy-rules/0.log"
Jul 13 21:57:03.328568 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:03.328538    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ccbdc876f-b4wzz_40d88f3a-7e5f-4e9b-9ee8-e02545caae41/kube-rbac-proxy-metrics/0.log"
Jul 13 21:57:04.163046 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.163011    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"]
Jul 13 21:57:04.168249 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.168183    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.171873 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.171836    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"]
Jul 13 21:57:04.223537 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.223494    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8a56613-e941-4692-a14c-31abcdef71f5-lib-modules\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.223868 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.223850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8a56613-e941-4692-a14c-31abcdef71f5-proc\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.223997 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.223981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8a56613-e941-4692-a14c-31abcdef71f5-podres\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.224169 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.224151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm95p\" (UniqueName: \"kubernetes.io/projected/b8a56613-e941-4692-a14c-31abcdef71f5-kube-api-access-wm95p\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.224286 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.224272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8a56613-e941-4692-a14c-31abcdef71f5-sys\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.324992 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.324950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8a56613-e941-4692-a14c-31abcdef71f5-proc\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.325470 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.325009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8a56613-e941-4692-a14c-31abcdef71f5-podres\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.325470 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.325065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8a56613-e941-4692-a14c-31abcdef71f5-proc\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.325470 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.325093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm95p\" (UniqueName: \"kubernetes.io/projected/b8a56613-e941-4692-a14c-31abcdef71f5-kube-api-access-wm95p\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.325470 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.325133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8a56613-e941-4692-a14c-31abcdef71f5-sys\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.325470 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.325197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8a56613-e941-4692-a14c-31abcdef71f5-lib-modules\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.325470 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.325206    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8a56613-e941-4692-a14c-31abcdef71f5-podres\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.325470 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.325303    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8a56613-e941-4692-a14c-31abcdef71f5-sys\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.325470 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.325411    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8a56613-e941-4692-a14c-31abcdef71f5-lib-modules\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.333922 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.333891    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm95p\" (UniqueName: \"kubernetes.io/projected/b8a56613-e941-4692-a14c-31abcdef71f5-kube-api-access-wm95p\") pod \"perf-node-gather-daemonset-6fzlx\" (UID: \"b8a56613-e941-4692-a14c-31abcdef71f5\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.487355 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.487264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:04.677749 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:04.677710    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"]
Jul 13 21:57:04.678460 ip-10-0-128-82 kubenswrapper[2580]: W0713 21:57:04.678427    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb8a56613_e941_4692_a14c_31abcdef71f5.slice/crio-5f95e8d080de2a9273784f5ebae262da0830a7d2dd4967be53c742ebef8bb9c6 WatchSource:0}: Error finding container 5f95e8d080de2a9273784f5ebae262da0830a7d2dd4967be53c742ebef8bb9c6: Status 404 returned error can't find the container with id 5f95e8d080de2a9273784f5ebae262da0830a7d2dd4967be53c742ebef8bb9c6
Jul 13 21:57:05.034840 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:05.034807    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-d7676_12d8caae-7bc1-46fd-9f2a-319beb4ecba5/console-operator/0.log"
Jul 13 21:57:05.070704 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:05.069591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx" event={"ID":"b8a56613-e941-4692-a14c-31abcdef71f5","Type":"ContainerStarted","Data":"b670ccba2e42fc09a6e10d27ef69c098af32d4ee0ab8d97c4756e889d8851d7d"}
Jul 13 21:57:05.070704 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:05.069655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx" event={"ID":"b8a56613-e941-4692-a14c-31abcdef71f5","Type":"ContainerStarted","Data":"5f95e8d080de2a9273784f5ebae262da0830a7d2dd4967be53c742ebef8bb9c6"}
Jul 13 21:57:05.070704 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:05.070583    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:05.488552 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:05.488518    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-96f4f569c-vsn6h_edcc4367-5003-46ba-9a82-169b9dc89e0a/console/0.log"
Jul 13 21:57:07.176963 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:07.176902    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zf7m7_0ac615bd-67c0-46c3-a479-9f5031782569/dns/0.log"
Jul 13 21:57:07.197185 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:07.197162    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zf7m7_0ac615bd-67c0-46c3-a479-9f5031782569/kube-rbac-proxy/0.log"
Jul 13 21:57:07.218848 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:07.218822    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gpsp2_d1a7f988-c495-4a1a-a6d6-372164fd830b/dns-node-resolver/0.log"
Jul 13 21:57:07.846023 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:07.845984    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p8xlt_08b33c6b-c74d-4666-a461-47432d836c89/node-ca/0.log"
Jul 13 21:57:08.751376 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:08.751292    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678gk47m_a2199ec2-c67c-42c1-a5db-11347291d62c/istio-proxy/0.log"
Jul 13 21:57:08.985565 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:08.985512    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-575f48bc89-nxr4c_aad8d512-d710-4129-b320-e9f95909b9af/kube-auth-proxy/0.log"
Jul 13 21:57:09.037135 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:09.037051    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dgd8s_7a74ec01-192b-49c8-90e2-a8168f8bc7f1/istio-proxy/0.log"
Jul 13 21:57:09.079284 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:09.079218    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dgd8s_7a74ec01-192b-49c8-90e2-a8168f8bc7f1/istio-proxy/1.log"
Jul 13 21:57:09.183043 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:09.183016    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85856c9868-5bg85_b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9/router/0.log"
Jul 13 21:57:09.892395 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:09.892336    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wh5tq_2fb02e34-7059-4d59-884f-4e9a747fef9f/serve-healthcheck-canary/0.log"
Jul 13 21:57:10.360721 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:10.360628    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-rlzlx_27c50b55-4334-4c9d-be8b-d3b6d3dfd3cf/insights-operator/0.log"
Jul 13 21:57:10.513893 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:10.513853    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s5cvs_68b0bfb3-106f-4f8e-8a9e-8200729e2eaa/kube-rbac-proxy/0.log"
Jul 13 21:57:10.534158 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:10.534114    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s5cvs_68b0bfb3-106f-4f8e-8a9e-8200729e2eaa/exporter/0.log"
Jul 13 21:57:10.557867 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:10.557827    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s5cvs_68b0bfb3-106f-4f8e-8a9e-8200729e2eaa/extractor/0.log"
Jul 13 21:57:12.095478 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:12.095449    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx"
Jul 13 21:57:12.111507 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:12.111454    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-6fzlx" podStartSLOduration=8.111435498 podStartE2EDuration="8.111435498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:57:05.086692266 +0000 UTC m=+2868.941837148" watchObservedRunningTime="2026-07-13 21:57:12.111435498 +0000 UTC m=+2875.966580425"
Jul 13 21:57:12.695245 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:12.695211    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v8thl_7283185f-f3c1-4851-a750-8a26199e1870/manager/0.log"
Jul 13 21:57:12.889024 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:12.888990    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8k5t2_e50cfc03-ffa9-4b94-815a-4ad45f2d2736/manager/0.log"
Jul 13 21:57:13.106093 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:13.106057    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zm5t9_9c98b41c-9d63-4b8b-882e-01ba7ad49241/server/0.log"
Jul 13 21:57:13.214335 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:13.214307    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8gm2n_2ce4d85b-8865-4ba9-bbc5-6d73b73485cd/manager/0.log"
Jul 13 21:57:13.434448 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:13.434409    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fb46456c-srrq6_6cd4cba3-f405-4b3a-9364-349061346f19/manager/0.log"
Jul 13 21:57:13.460075 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:13.460046    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fb46456c-srrq6_6cd4cba3-f405-4b3a-9364-349061346f19/copy-manifests/0.log"
Jul 13 21:57:15.095430 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:15.095369    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678gk47m_a2199ec2-c67c-42c1-a5db-11347291d62c/istio-proxy/0.log"
Jul 13 21:57:15.316221 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:15.316197    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-575f48bc89-nxr4c_aad8d512-d710-4129-b320-e9f95909b9af/kube-auth-proxy/0.log"
Jul 13 21:57:15.354424 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:15.354322    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dgd8s_7a74ec01-192b-49c8-90e2-a8168f8bc7f1/istio-proxy/0.log"
Jul 13 21:57:15.397556 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:15.397521    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dgd8s_7a74ec01-192b-49c8-90e2-a8168f8bc7f1/istio-proxy/1.log"
Jul 13 21:57:15.475040 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:15.474999    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85856c9868-5bg85_b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9/router/0.log"
Jul 13 21:57:16.685036 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:16.685006    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678gk47m_a2199ec2-c67c-42c1-a5db-11347291d62c/istio-proxy/0.log"
Jul 13 21:57:16.909828 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:16.909735    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-575f48bc89-nxr4c_aad8d512-d710-4129-b320-e9f95909b9af/kube-auth-proxy/0.log"
Jul 13 21:57:16.945659 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:16.945569    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dgd8s_7a74ec01-192b-49c8-90e2-a8168f8bc7f1/istio-proxy/0.log"
Jul 13 21:57:16.987281 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:16.987249    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dgd8s_7a74ec01-192b-49c8-90e2-a8168f8bc7f1/istio-proxy/1.log"
Jul 13 21:57:17.065600 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:17.065569    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85856c9868-5bg85_b1b2ab89-b507-4fe3-b1d1-ac4b7d4eb0c9/router/0.log"
Jul 13 21:57:20.097415 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:20.097357    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-d4tmx_cfd0ba3a-0c38-431e-b74b-92e8b97a295f/kube-storage-version-migrator-operator/0.log"
Jul 13 21:57:21.048692 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:21.048660    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-67xqp_f46d7a90-17ca-474d-8c35-e44e1e222184/kube-multus/0.log"
Jul 13 21:57:21.225115 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:21.225082    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clhj6_19344c9e-fc2c-4cb5-84de-2f024b60eabf/kube-multus-additional-cni-plugins/0.log"
Jul 13 21:57:21.244430 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:21.244404    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clhj6_19344c9e-fc2c-4cb5-84de-2f024b60eabf/egress-router-binary-copy/0.log"
Jul 13 21:57:21.263426 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:21.263401    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clhj6_19344c9e-fc2c-4cb5-84de-2f024b60eabf/cni-plugins/0.log"
Jul 13 21:57:21.283087 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:21.283063    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clhj6_19344c9e-fc2c-4cb5-84de-2f024b60eabf/bond-cni-plugin/0.log"
Jul 13 21:57:21.304370 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:21.304294    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clhj6_19344c9e-fc2c-4cb5-84de-2f024b60eabf/routeoverride-cni/0.log"
Jul 13 21:57:21.325623 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:21.325594    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clhj6_19344c9e-fc2c-4cb5-84de-2f024b60eabf/whereabouts-cni-bincopy/0.log"
Jul 13 21:57:21.344883 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:21.344858    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clhj6_19344c9e-fc2c-4cb5-84de-2f024b60eabf/whereabouts-cni/0.log"
Jul 13 21:57:21.599991 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:21.599909    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b86vq_9482820b-d3b9-4d4e-b538-6c33fcbf5312/network-metrics-daemon/0.log"
Jul 13 21:57:21.629880 ip-10-0-128-82 kubenswrapper[2580]: I0713 21:57:21.629851    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b86vq_9482820b-d3b9-4d4e-b538-6c33fcbf5312/kube-rbac-proxy/0.log"