Jul 20 13:36:38.490940 ip-10-0-134-120 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 13:36:38.490955 ip-10-0-134-120 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 13:36:38.490966 ip-10-0-134-120 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 13:36:38.491314 ip-10-0-134-120 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 13:36:48.711615 ip-10-0-134-120 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 20 13:36:48.711636 ip-10-0-134-120 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1bb420a5f029494f8558dd1e80b21bcf --
Jul 20 13:38:28.342739 ip-10-0-134-120 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 13:38:28.706384 ip-10-0-134-120 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 13:38:28.706384 ip-10-0-134-120 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 13:38:28.706384 ip-10-0-134-120 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 13:38:28.706384 ip-10-0-134-120 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 13:38:28.706384 ip-10-0-134-120 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 13:38:28.708018 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.707899    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 13:38:28.713166 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713148    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:38:28.713166 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713165    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713169    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713172    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713174    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713178    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713181    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713183    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713186    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713189    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713191    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713194    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713198    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713200    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713203    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713206    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713208    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713211    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713213    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713216    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713218    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:38:28.713231 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713221    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713223    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713226    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713228    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713231    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713233    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713236    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713239    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713241    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713244    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713248    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713252    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713255    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713258    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713260    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713263    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713266    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713268    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713270    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713273    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:38:28.713711 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713276    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713278    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713281    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713283    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713285    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713288    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713290    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713293    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713295    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713297    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713300    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713302    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713305    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713307    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713312    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713317    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713320    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713322    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713325    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:38:28.714200 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713328    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713330    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713333    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713335    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713338    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713340    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713343    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713345    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713347    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713350    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713353    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713356    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713358    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713361    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713363    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713366    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713369    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713371    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713374    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713376    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:38:28.714677 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713379    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713381    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713384    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713386    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713388    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713391    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713394    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713397    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713412    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713415    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713419    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713422    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713425    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713428    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713431    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713434    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713437    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713439    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.713442    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:38:28.715192 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714134    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714142    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714182    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714201    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714206    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714211    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714214    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714218    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714221    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714223    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714226    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714231    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714235    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714238    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714241    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714243    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714246    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714249    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714251    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:38:28.715659 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714254    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714257    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714260    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714262    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714265    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714268    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714270    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714273    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714275    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714278    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714280    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714282    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714285    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714287    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714290    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714293    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714297    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714299    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714302    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714305    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:38:28.716128 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714307    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714309    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714312    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714314    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714320    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714323    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714325    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714328    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714330    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714333    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714335    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714338    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714341    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714344    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714347    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714349    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714352    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714354    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714357    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714359    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:38:28.716647 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714361    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714364    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714366    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714368    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714371    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714374    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714376    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714379    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714382    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714385    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714388    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714390    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714394    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714397    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714399    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714415    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714418    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714420    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714423    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714426    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714428    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:38:28.717139 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714431    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714435    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714438    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714441    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714444    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714447    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714449    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714452    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714454    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714457    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714459    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714462    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714464    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714467    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714469    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714472    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714474    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714476    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714479    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:38:28.717661 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714925    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714933    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714936    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714940    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714944    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714947    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714950    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714952    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714955    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714958    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714961    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714963    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714966    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714969    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714972    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714975    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714977    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714979    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714982    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714984    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:38:28.718116 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714987    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714989    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714992    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714994    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714997    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.714999    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715001    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715005    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715007    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715010    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715012    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715016    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715020    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715024    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715027    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715030    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715032    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715035    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715037    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:38:28.718619 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715040    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715042    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715045    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715048    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715051    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715053    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715055    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715058    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715061    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715063    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715065    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715068    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715070    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715073    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715075    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715077    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715080    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715082    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715085    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:38:28.719066 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715087    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715089    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715092    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715094    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715097    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715100    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715102    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715105    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715107    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715112    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715114    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715117    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715119    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715121    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715124    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715126    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715130    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715133    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715135    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715137    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:38:28.719573 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715141    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715144    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715147    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715149    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715152    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715154    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715156    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715159    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715161    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715163    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715166    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715168    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715171    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715173    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715175    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715178    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715180    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715183    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715186    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715189    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:38:28.720049 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715191    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715259    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715267    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715273    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715278    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715282    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715285    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715289    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715294    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715297    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715300    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715303    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715306    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715309    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715312    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715315    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715318    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715321    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715323    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715327    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715330    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715333    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715336    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715339    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 13:38:28.720556 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715342    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715345    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715348    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715351    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715354    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715357    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715360    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715363    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715366    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715370    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715373    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715377    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715380    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715383    2563 flags.go:64] FLAG: --enable-server="true"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715385    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715390    2563 flags.go:64] FLAG: --event-burst="100"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715393    2563 flags.go:64] FLAG: --event-qps="50"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715396    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715398    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715418    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715422    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715425    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715428    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715431    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715434    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 13:38:28.721138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715437    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715440    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715443    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715445    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715448    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715451    2563 flags.go:64] FLAG: --feature-gates=""
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715454    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715457    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715460    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715463    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715466    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715469    2563 flags.go:64] FLAG: --help="false"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715472    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-134-120.ec2.internal"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715476    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715479    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715482    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715485    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715488    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715491    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715500    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715503    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715506    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715509    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715512    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 13:38:28.721763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715515    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715517    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715520    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715523    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715526    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715528    2563 flags.go:64] FLAG: --lock-file=""
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715531    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715533    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715536    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715542    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715545    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715547    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715550    2563 flags.go:64] FLAG: --logging-format="text"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715553    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715556    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715559    2563 flags.go:64] FLAG: --manifest-url=""
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715562    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715566    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715570    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715574    2563 flags.go:64] FLAG: --max-pods="110"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715577    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715582    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715585    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715588    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715592    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 13:38:28.722354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715594    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715597    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715604    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715607    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715610    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715613    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715616    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715621    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715623    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715627    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715629    2563 flags.go:64] FLAG: --port="10250"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715632    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715635    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-080607eb275257498"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715638    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715641    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715643    2563 flags.go:64] FLAG: --register-node="true"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715648    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715654    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715657    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715660    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715663    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715667    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715670    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715673    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715675    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 13:38:28.722994 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715678    2563 flags.go:64] FLAG: --runonce="false"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715681    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715684    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715688    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715690    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715693    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715696    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715699    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715702    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715705    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715707    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715711    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715713    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715716    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715719    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715722    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715727    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715729    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715732    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715736    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715739    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715741    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715744    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715747    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715750    2563 flags.go:64] FLAG: --v="2"
Jul 20 13:38:28.723644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715754    2563 flags.go:64] FLAG: --version="false"
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715757    2563 flags.go:64] FLAG: --vmodule=""
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715761    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.715764    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715877    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715881    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715884    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715887    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715890    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715892    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715896    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715899    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715903    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715905    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715908    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715911    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715913    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715916    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715918    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715921    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715924    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:38:28.724260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715926    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715930    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715933    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715935    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715938    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715941    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715943    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715945    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715948    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715950    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715953    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715956    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715958    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715961    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715963    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715965    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715968    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715970    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715973    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:38:28.724773 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715975    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715977    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715982    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715985    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715987    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715990    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715992    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715995    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715997    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.715999    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716002    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716004    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716007    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716009    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716012    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716014    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716017    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716019    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716023    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:38:28.725234 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716026    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716029    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716032    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716035    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716038    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716041    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716043    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716046    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716049    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716051    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716054    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716056    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716059    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716061    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716063    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716067    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716071    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716074    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716077    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:38:28.725798 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716079    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716082    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716085    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716087    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716090    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716092    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716095    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716098    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716100    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716103    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716105    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716107    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716110    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716112    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716115    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716117    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716119    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716122    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716124    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716126    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:38:28.726254 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716129    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716131    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716134    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716137    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.716139    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.716732    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.724130    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.724149    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.724170    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.724175    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724240    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724246    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724249    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724252    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:38:28.727175 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724255    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724258    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724261    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724266    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724270    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724274    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724279    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724283    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724285    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724288    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724291    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724294    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724297    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724299    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724301    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724304    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724306    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724309    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724311    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:38:28.727626 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724314    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724316    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724318    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724321    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724323    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724325    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724329    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724331    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724334    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724336    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724339    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724341    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724344    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724346    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724349    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724351    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724353    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724356    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724358    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724361    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:38:28.728089 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724364    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724366    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724369    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724371    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724374    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724376    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724379    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724381    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724384    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724386    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724390    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724392    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724394    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724397    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724399    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724420    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724422    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724425    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724428    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724431    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:38:28.728604 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724434    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724436    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724440    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724443    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724446    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724449    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724452    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724454    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724457    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724459    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724462    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724464    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724468    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724470    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724472    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724475    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724478    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724480    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724483    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:38:28.729088 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724485    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724488    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724490    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724493    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724495    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724497    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724500    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724503    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724505    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724508    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724510    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724513    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724515    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724518    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724520    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724523    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:38:28.729568 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724525    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.724530    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724652    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724656    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724659    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724662    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724665    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724667    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724669    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724672    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724675    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724677    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724680    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724682    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:38:28.729952 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724685    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724688    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724691    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724693    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724696    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724698    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724701    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724704    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724706    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724709    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724711    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724713    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724716    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724719    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724721    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724723    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724726    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724728    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724731    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724733    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:38:28.730304 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724735    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724738    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724741    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724745    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724747    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724750    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724753    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724756    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724759    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724762    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724765    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724767    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724769    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724772    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724774    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724777    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724779    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724782    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724785    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:38:28.730805 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724787    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724790    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724793    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724795    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724797    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724800    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724802    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724805    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724807    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724810    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724814    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724817    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724820    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724823    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724825    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724828    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724830    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724833    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724835    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724838    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:38:28.731258 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724840    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724842    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724845    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724848    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724850    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724852    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724855    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724857    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724859    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724862    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724864    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724867    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724869    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724872    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724874    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724876    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724878    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724881    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724884    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:38:28.731845 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724886    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724888    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724891    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724893    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724896    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724898    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724901    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724903    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:28.724906    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.724911    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.725021    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.728858    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.730302    2563 server.go:1019] "Starting client certificate rotation"
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.730415    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 13:38:28.732297 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.730456    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 13:38:28.732801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.732787    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 13:38:28.734001 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.733980    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 13:38:28.745257 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.745238    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 20 13:38:28.747639 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.747624    2563 log.go:25] "Validated CRI v1 image API"
Jul 20 13:38:28.750085 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.750071    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 13:38:28.752531 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.752500    2563 fs.go:135] Filesystem UUIDs: map[0d1f59bf-eb5f-4d20-88dd-11ee1f9f8c23:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a573ef5f-6381-4866-9225-dd76bb183583:/dev/nvme0n1p3]
Jul 20 13:38:28.752621 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.752529    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.758036    2563 manager.go:216] Machine: {Timestamp:2026-07-20 13:38:28.756981876 +0000 UTC m=+0.304553252 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3142801 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2432cac67260ea8f8b67f51bf45d50 SystemUUID:ec2432ca-c672-60ea-8f8b-67f51bf45d50 BootID:1bb420a5-f029-494f-8558-dd1e80b21bcf Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:12:15:09:1d:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:12:15:09:1d:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:6b:a1:da:75:97 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.758147    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.758229    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.760813    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.760840    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-120.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.761561    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.761570    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.761582    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.762203    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.763015    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.763294    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.765754    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.765870    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.765894    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.765905    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.765915    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 13:38:28.762801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.765924    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 20 13:38:28.767961 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.765933    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 13:38:28.767961 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.766293    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 13:38:28.767961 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.766307    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 13:38:28.771789 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.771766    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 13:38:28.773637 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.773624    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 13:38:28.773693 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.773654    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 13:38:28.774538 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.774528    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 13:38:28.774611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.774543    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 13:38:28.774611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.774550    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 13:38:28.774611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.774556    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 13:38:28.774611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.774565    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 13:38:28.774611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.774570    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 13:38:28.774611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.774578    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 13:38:28.774611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.774583    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 13:38:28.774611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.774590    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 13:38:28.774611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.774595    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 13:38:28.774611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.774603    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 13:38:28.774611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.774609    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 13:38:28.775369 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.775360    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 13:38:28.775369 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.775369    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 13:38:28.778549 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.778536    2563 server.go:1268] "Started kubelet"
Jul 20 13:38:28.778680 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.778632    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 13:38:28.778753 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.778674    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 13:38:28.778806 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.778778    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 13:38:28.780017 ip-10-0-134-120 systemd[1]: Started Kubernetes Kubelet.
Jul 20 13:38:28.780746 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.780514    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 13:38:28.781202 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.781187    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 13:38:28.784579 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.784554    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 13:38:28.785210 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.785185    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 13:38:28.785495 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.785476    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-120.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 13:38:28.785614 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.785597    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 13:38:28.785924 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.785913    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 13:38:28.785978 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.785153    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-120.ec2.internal.18c4030d7afe5b0b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-120.ec2.internal,UID:ip-10-0-134-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-120.ec2.internal,},FirstTimestamp:2026-07-20 13:38:28.778507019 +0000 UTC m=+0.326078395,LastTimestamp:2026-07-20 13:38:28.778507019 +0000 UTC m=+0.326078395,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-120.ec2.internal,}"
Jul 20 13:38:28.785978 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.785925    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 13:38:28.786089 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.785985    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:28.786467 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.786452    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 13:38:28.786566 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.786453    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 13:38:28.786566 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.786566    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 13:38:28.786732 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.786645    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 13:38:28.786732 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.786654    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 13:38:28.786833 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.786802    2563 factory.go:55] Registering systemd factory
Jul 20 13:38:28.786833 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.786815    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 20 13:38:28.787663 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.787644    2563 factory.go:153] Registering CRI-O factory
Jul 20 13:38:28.787663 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.787665    2563 factory.go:223] Registration of the crio container factory successfully
Jul 20 13:38:28.787809 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.787708    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 13:38:28.787809 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.787726    2563 factory.go:103] Registering Raw factory
Jul 20 13:38:28.787809 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.787743    2563 manager.go:1196] Started watching for new ooms in manager
Jul 20 13:38:28.788100 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.788087    2563 manager.go:349] Starting recovery of all containers
Jul 20 13:38:28.788651 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.788607    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 13:38:28.795183 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.795153    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 13:38:28.797922 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.797902    2563 manager.go:354] Recovery completed
Jul 20 13:38:28.799020 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.798988    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 13:38:28.803510 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.803496    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:28.805595 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.805572    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:28.805659 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.805612    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:28.805659 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.805623    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:28.806143 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.806130    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 13:38:28.806143 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.806141    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:28.806220 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.806143    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 13:38:28.806220 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.806195    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 13:38:28.806803 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.806787    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:28.806867 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.806813    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:28.806867 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.806823    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:28.807314 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.807303    2563 policy_none.go:49] "None policy: Start"
Jul 20 13:38:28.807342 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.807318    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 13:38:28.807342 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.807328    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 13:38:28.808263 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.808161    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-120.ec2.internal.18c4030d7c9bbad4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-120.ec2.internal,UID:ip-10-0-134-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-120.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-120.ec2.internal,},FirstTimestamp:2026-07-20 13:38:28.805597908 +0000 UTC m=+0.353169289,LastTimestamp:2026-07-20 13:38:28.805597908 +0000 UTC m=+0.353169289,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-120.ec2.internal,}"
Jul 20 13:38:28.808461 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.808447    2563 policy_none.go:47] "Start"
Jul 20 13:38:28.820231 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.820027    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-120.ec2.internal.18c4030d7c9c06ed  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-120.ec2.internal,UID:ip-10-0-134-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-120.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-120.ec2.internal,},FirstTimestamp:2026-07-20 13:38:28.805617389 +0000 UTC m=+0.353188765,LastTimestamp:2026-07-20 13:38:28.805617389 +0000 UTC m=+0.353188765,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-120.ec2.internal,}"
Jul 20 13:38:28.833036 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.832933    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-120.ec2.internal.18c4030d7c9c2c76  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-120.ec2.internal,UID:ip-10-0-134-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-120.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-120.ec2.internal,},FirstTimestamp:2026-07-20 13:38:28.805626998 +0000 UTC m=+0.353198375,LastTimestamp:2026-07-20 13:38:28.805626998 +0000 UTC m=+0.353198375,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-120.ec2.internal,}"
Jul 20 13:38:28.834746 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.834728    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k99bb"
Jul 20 13:38:28.841371 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.841358    2563 manager.go:337] "Starting Device Plugin manager"
Jul 20 13:38:28.841494 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.841389    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 13:38:28.841494 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.841399    2563 server.go:87] "Starting device plugin registration server"
Jul 20 13:38:28.841709 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.841696    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 13:38:28.841777 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.841712    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 13:38:28.841832 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.841800    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 13:38:28.841877 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.841871    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 13:38:28.841924 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.841878    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 13:38:28.842467 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.842448    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 13:38:28.842561 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.842499    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:28.844065 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.844048    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k99bb"
Jul 20 13:38:28.845882 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.845813    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-120.ec2.internal.18c4030d7c9bbad4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-120.ec2.internal.18c4030d7c9bbad4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-120.ec2.internal,UID:ip-10-0-134-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-120.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-120.ec2.internal,},FirstTimestamp:2026-07-20 13:38:28.805597908 +0000 UTC m=+0.353169289,LastTimestamp:2026-07-20 13:38:28.806801303 +0000 UTC m=+0.354372679,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-120.ec2.internal,}"
Jul 20 13:38:28.939750 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.939715    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 13:38:28.940706 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.939764    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 13:38:28.940706 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.939790    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 13:38:28.940706 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.939830    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 13:38:28.942371 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.942349    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:28.942505 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.942473    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:38:28.943121 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.943105    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:28.943202 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.943135    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:28.943202 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.943147    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:28.943202 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.943174    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-120.ec2.internal"
Jul 20 13:38:28.956865 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:28.956807    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-120.ec2.internal"
Jul 20 13:38:28.956865 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:28.956832    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-120.ec2.internal\": node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:29.006917 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:29.006878    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:29.040050 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.040016    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-120.ec2.internal"]
Jul 20 13:38:29.040143 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.040118    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:29.041062 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.041040    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:29.041157 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.041074    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:29.041157 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.041090    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:29.042254 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.042241    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:29.042369 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.042354    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.042447 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.042386    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:29.042984 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.042969    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:29.043079 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.042989    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:29.043079 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.042998    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:29.043079 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.043017    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:29.043079 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.043037    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:29.043079 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.043047    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:29.044161 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.044143    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.044269 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.044173    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:29.044868 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.044850    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:29.044972 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.044876    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:29.044972 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.044887    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:29.072256 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:29.072226    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-120.ec2.internal\" not found" node="ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.076944 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:29.076925    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-120.ec2.internal\" not found" node="ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.087946 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.087920    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2117fdb9fb6973c962e79220899020b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal\" (UID: \"2117fdb9fb6973c962e79220899020b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.088053 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.087960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2117fdb9fb6973c962e79220899020b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal\" (UID: \"2117fdb9fb6973c962e79220899020b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.088053 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.087980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90da8d909eb6fafa78270e85990e7272-config\") pod \"kube-apiserver-proxy-ip-10-0-134-120.ec2.internal\" (UID: \"90da8d909eb6fafa78270e85990e7272\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.106977 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:29.106952    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:29.188311 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.188279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2117fdb9fb6973c962e79220899020b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal\" (UID: \"2117fdb9fb6973c962e79220899020b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.188509 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.188316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2117fdb9fb6973c962e79220899020b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal\" (UID: \"2117fdb9fb6973c962e79220899020b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.188509 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.188345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90da8d909eb6fafa78270e85990e7272-config\") pod \"kube-apiserver-proxy-ip-10-0-134-120.ec2.internal\" (UID: \"90da8d909eb6fafa78270e85990e7272\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.188509 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.188381    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90da8d909eb6fafa78270e85990e7272-config\") pod \"kube-apiserver-proxy-ip-10-0-134-120.ec2.internal\" (UID: \"90da8d909eb6fafa78270e85990e7272\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.188509 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.188389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2117fdb9fb6973c962e79220899020b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal\" (UID: \"2117fdb9fb6973c962e79220899020b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.188509 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.188380    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2117fdb9fb6973c962e79220899020b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal\" (UID: \"2117fdb9fb6973c962e79220899020b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.207077 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:29.206999    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:29.307108 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:29.307069    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:29.375302 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.375271    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.380434 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.379865    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:29.407864 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:29.407827    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:29.508384 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:29.508291    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:29.608913 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:29.608876    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:29.709637 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:29.709603    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:29.729808 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.729770    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 13:38:29.729978 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.729903    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 13:38:29.809953 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:29.809928    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:29.850003 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.849927    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 13:33:29 +0000 UTC" deadline="2028-04-13 17:27:31.935918242 +0000 UTC"
Jul 20 13:38:29.850003 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.849975    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15195h49m2.085949526s"
Jul 20 13:38:29.859471 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.859443    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:29.860797 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.860778    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:29.860906 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.860809    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:29.860906 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.860819    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:29.868419 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.868391    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:38:29.910271 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:29.910232    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:29.932325 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:29.932295    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2117fdb9fb6973c962e79220899020b6.slice/crio-88590536894a544978f09c7046b02fc3398c01719777c95e7f758f8544126bad WatchSource:0}: Error finding container 88590536894a544978f09c7046b02fc3398c01719777c95e7f758f8544126bad: Status 404 returned error can't find the container with id 88590536894a544978f09c7046b02fc3398c01719777c95e7f758f8544126bad
Jul 20 13:38:29.932919 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:29.932904    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90da8d909eb6fafa78270e85990e7272.slice/crio-8d60820a1b1d8c52bff72f4ebb866c8542fa327ff9d44f7dfdc17b92f84e4297 WatchSource:0}: Error finding container 8d60820a1b1d8c52bff72f4ebb866c8542fa327ff9d44f7dfdc17b92f84e4297: Status 404 returned error can't find the container with id 8d60820a1b1d8c52bff72f4ebb866c8542fa327ff9d44f7dfdc17b92f84e4297
Jul 20 13:38:29.937577 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.937560    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:38:29.943428 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.943370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-120.ec2.internal" event={"ID":"90da8d909eb6fafa78270e85990e7272","Type":"ContainerStarted","Data":"8d60820a1b1d8c52bff72f4ebb866c8542fa327ff9d44f7dfdc17b92f84e4297"}
Jul 20 13:38:29.944510 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:29.944484    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal" event={"ID":"2117fdb9fb6973c962e79220899020b6","Type":"ContainerStarted","Data":"88590536894a544978f09c7046b02fc3398c01719777c95e7f758f8544126bad"}
Jul 20 13:38:30.010974 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:30.010930    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:30.111537 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:30.111459    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-120.ec2.internal\" not found"
Jul 20 13:38:30.126394 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.126363    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:38:30.186698 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.186665    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:30.207380 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.207347    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 13:38:30.209081 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.209065    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-120.ec2.internal"
Jul 20 13:38:30.232134 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.232099    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 13:38:30.340031 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.339993    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:38:30.767827 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.767795    2563 apiserver.go:52] "Watching apiserver"
Jul 20 13:38:30.777940 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.777904    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 13:38:30.779256 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.779218    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6","openshift-cluster-node-tuning-operator/tuned-bhb2j","openshift-image-registry/node-ca-lr5ls","openshift-multus/multus-m5bvt","openshift-network-diagnostics/network-check-target-vq2hf","kube-system/global-pull-secret-syncer-82vx5","kube-system/kube-apiserver-proxy-ip-10-0-134-120.ec2.internal","openshift-dns/node-resolver-5mbgg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal","openshift-multus/multus-additional-cni-plugins-w578t","openshift-multus/network-metrics-daemon-q4n2d","openshift-network-operator/iptables-alerter-fb9tn","openshift-ovn-kubernetes/ovnkube-node-pk7fg","kube-system/konnectivity-agent-z9m75"]
Jul 20 13:38:30.782071 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.782041    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.786524 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.786487    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.786693 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.786674    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 13:38:30.789418 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.789046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lr5ls"
Jul 20 13:38:30.789418 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.789162    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 13:38:30.791597 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.791572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.794356 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.794105    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:30.794356 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:30.794179    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:30.795526 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.795500    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 13:38:30.795677 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.795656    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 13:38:30.795751 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.795695    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 13:38:30.795751 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.795502    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 13:38:30.795935 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.795921    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 13:38:30.795983 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.795933    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 13:38:30.796095 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.796081    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 13:38:30.797313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.797293    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.797539    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.797690    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.797894    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xz6hs\""
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.798061    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9jflk\""
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.798192    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.798396    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.798569    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9j9p5\""
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.798704    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-systemd-units\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57041bdb-e9e0-4912-8437-8aec52acdcc6-os-release\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-var-lib-openvswitch\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/118b9d1b-1958-44a7-a291-ed765a1ff95b-ovnkube-script-lib\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbcks\" (UniqueName: \"kubernetes.io/projected/57041bdb-e9e0-4912-8437-8aec52acdcc6-kube-api-access-xbcks\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-run-ovn\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/118b9d1b-1958-44a7-a291-ed765a1ff95b-env-overrides\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57041bdb-e9e0-4912-8437-8aec52acdcc6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-run-systemd\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799896    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-cni-bin\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/118b9d1b-1958-44a7-a291-ed765a1ff95b-ovn-node-metrics-cert\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.802047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tlbt\" (UniqueName: \"kubernetes.io/projected/beb433e1-340e-4e3d-bced-322403fe86c9-kube-api-access-7tlbt\") pod \"node-ca-lr5ls\" (UID: \"beb433e1-340e-4e3d-bced-322403fe86c9\") " pod="openshift-image-registry/node-ca-lr5ls"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:30.799964    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.799974    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sfrj2\""
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57041bdb-e9e0-4912-8437-8aec52acdcc6-cnibin\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57041bdb-e9e0-4912-8437-8aec52acdcc6-cni-binary-copy\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-cni-netd\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/beb433e1-340e-4e3d-bced-322403fe86c9-serviceca\") pod \"node-ca-lr5ls\" (UID: \"beb433e1-340e-4e3d-bced-322403fe86c9\") " pod="openshift-image-registry/node-ca-lr5ls"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57041bdb-e9e0-4912-8437-8aec52acdcc6-system-cni-dir\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-slash\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-run-netns\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/118b9d1b-1958-44a7-a291-ed765a1ff95b-ovnkube-config\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/beb433e1-340e-4e3d-bced-322403fe86c9-host\") pod \"node-ca-lr5ls\" (UID: \"beb433e1-340e-4e3d-bced-322403fe86c9\") " pod="openshift-image-registry/node-ca-lr5ls"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800333    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800331    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57041bdb-e9e0-4912-8437-8aec52acdcc6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57041bdb-e9e0-4912-8437-8aec52acdcc6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800399    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z9m75"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-kubelet\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.803315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-run-openvswitch\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.804318 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-node-log\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.804318 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-etc-openvswitch\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.804318 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-log-socket\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.804318 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800519    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.804318 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.800534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6ppd\" (UniqueName: \"kubernetes.io/projected/118b9d1b-1958-44a7-a291-ed765a1ff95b-kube-api-access-w6ppd\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.804318 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.802953    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mbgg"
Jul 20 13:38:30.805256 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.805233    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.805923 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.805902    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jts29\""
Jul 20 13:38:30.806110 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.806085    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 13:38:30.806110 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.806110    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 13:38:30.806439 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.806415    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ks2rz\""
Jul 20 13:38:30.806917 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.806752    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 13:38:30.807421 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.807398    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 13:38:30.808110 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.808077    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:30.809358 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.809328    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q8w8p\""
Jul 20 13:38:30.813907 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.813814    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 13:38:30.814155 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.814133    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 13:38:30.814246 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.814178    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:30.814316 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:30.814280    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:30.814596 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.814579    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 13:38:30.814768 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.814746    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xgpzr\""
Jul 20 13:38:30.814990 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.814598    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:38:30.815464 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.815443    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 13:38:30.816912 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.816894    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fb9tn"
Jul 20 13:38:30.820707 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.820686    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 13:38:30.820974 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.820955    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9dc9j\""
Jul 20 13:38:30.820974 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.820963    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:38:30.821671 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.821653    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 13:38:30.827323 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.827297    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 13:38:30.863361 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.863335    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:38:30.888494 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.888459    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 13:38:30.901636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.901599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-slash\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.901636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.901647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/118b9d1b-1958-44a7-a291-ed765a1ff95b-ovnkube-config\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.901904 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.901677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/beb433e1-340e-4e3d-bced-322403fe86c9-host\") pod \"node-ca-lr5ls\" (UID: \"beb433e1-340e-4e3d-bced-322403fe86c9\") " pod="openshift-image-registry/node-ca-lr5ls"
Jul 20 13:38:30.901904 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.901737    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/beb433e1-340e-4e3d-bced-322403fe86c9-host\") pod \"node-ca-lr5ls\" (UID: \"beb433e1-340e-4e3d-bced-322403fe86c9\") " pod="openshift-image-registry/node-ca-lr5ls"
Jul 20 13:38:30.901904 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.901745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-slash\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.901904 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.901798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-597pp\" (UniqueName: \"kubernetes.io/projected/cf35963e-8fbe-4e77-9e64-1d7d857b0758-kube-api-access-597pp\") pod \"iptables-alerter-fb9tn\" (UID: \"cf35963e-8fbe-4e77-9e64-1d7d857b0758\") " pod="openshift-network-operator/iptables-alerter-fb9tn"
Jul 20 13:38:30.901904 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.901836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.901904 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.901870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57041bdb-e9e0-4912-8437-8aec52acdcc6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.901904 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.901904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.901932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-var-lib-kubelet\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.901958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpw8d\" (UniqueName: \"kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d\") pod \"network-check-target-vq2hf\" (UID: \"4b71405d-76e4-468b-bfcc-51b2e5550ca2\") " pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.901985    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-etc-openvswitch\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-modprobe-d\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-lib-modules\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plmfc\" (UniqueName: \"kubernetes.io/projected/72c0fcdd-9c9b-451d-94f9-511d42be0132-kube-api-access-plmfc\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cf35963e-8fbe-4e77-9e64-1d7d857b0758-iptables-alerter-script\") pod \"iptables-alerter-fb9tn\" (UID: \"cf35963e-8fbe-4e77-9e64-1d7d857b0758\") " pod="openshift-network-operator/iptables-alerter-fb9tn"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-run-multus-certs\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57041bdb-e9e0-4912-8437-8aec52acdcc6-os-release\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-var-lib-openvswitch\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/118b9d1b-1958-44a7-a291-ed765a1ff95b-ovnkube-script-lib\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68nhd\" (UniqueName: \"kubernetes.io/projected/319a2633-83bc-45e4-8b3b-b7ff8237f628-kube-api-access-68nhd\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-etc-selinux\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:30.902259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-sys-fs\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf35963e-8fbe-4e77-9e64-1d7d857b0758-host-slash\") pod \"iptables-alerter-fb9tn\" (UID: \"cf35963e-8fbe-4e77-9e64-1d7d857b0758\") " pod="openshift-network-operator/iptables-alerter-fb9tn"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-run-netns\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-run-ovn\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-var-lib-kubelet\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-tuned\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-socket-dir\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-device-dir\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902512    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/118b9d1b-1958-44a7-a291-ed765a1ff95b-ovnkube-config\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3280b00c-71b5-4dd0-b683-3a8560f70c83-multus-daemon-config\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-etc-kubernetes\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-cni-bin\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tlbt\" (UniqueName: \"kubernetes.io/projected/beb433e1-340e-4e3d-bced-322403fe86c9-kube-api-access-7tlbt\") pod \"node-ca-lr5ls\" (UID: \"beb433e1-340e-4e3d-bced-322403fe86c9\") " pod="openshift-image-registry/node-ca-lr5ls"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57041bdb-e9e0-4912-8437-8aec52acdcc6-cni-binary-copy\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-cni-netd\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.903017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/beb433e1-340e-4e3d-bced-322403fe86c9-serviceca\") pod \"node-ca-lr5ls\" (UID: \"beb433e1-340e-4e3d-bced-322403fe86c9\") " pod="openshift-image-registry/node-ca-lr5ls"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-sysctl-conf\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-multus-cni-dir\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-os-release\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902912    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-run-k8s-cni-cncf-io\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-run\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-var-lib-cni-bin\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.902995    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57041bdb-e9e0-4912-8437-8aec52acdcc6-system-cni-dir\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903020    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-run-netns\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-host\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57041bdb-e9e0-4912-8437-8aec52acdcc6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903089    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/319a2633-83bc-45e4-8b3b-b7ff8237f628-tmp\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57041bdb-e9e0-4912-8437-8aec52acdcc6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-etc-openvswitch\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-kubelet\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-run-openvswitch\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.903897 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-node-log\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-sysctl-d\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903317    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57041bdb-e9e0-4912-8437-8aec52acdcc6-os-release\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-sys\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903362    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-var-lib-openvswitch\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-log-socket\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903413    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ppd\" (UniqueName: \"kubernetes.io/projected/118b9d1b-1958-44a7-a291-ed765a1ff95b-kube-api-access-w6ppd\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12aecb57-1243-492c-9f94-cadbcafa4b5f-dbus\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-registration-dir\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3280b00c-71b5-4dd0-b683-3a8560f70c83-cni-binary-copy\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-multus-conf-dir\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8vzk\" (UniqueName: \"kubernetes.io/projected/3280b00c-71b5-4dd0-b683-3a8560f70c83-kube-api-access-n8vzk\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6af5b675-8ee7-4c41-9e90-6497f9c3e88d-konnectivity-ca\") pod \"konnectivity-agent-z9m75\" (UID: \"6af5b675-8ee7-4c41-9e90-6497f9c3e88d\") " pod="kube-system/konnectivity-agent-z9m75"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-systemd-units\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-system-cni-dir\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6af5b675-8ee7-4c41-9e90-6497f9c3e88d-agent-certs\") pod \"konnectivity-agent-z9m75\" (UID: \"6af5b675-8ee7-4c41-9e90-6497f9c3e88d\") " pod="kube-system/konnectivity-agent-z9m75"
Jul 20 13:38:30.904776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0f556d50-37cb-4f6f-ab10-28f4b5e4318d-hosts-file\") pod \"node-resolver-5mbgg\" (UID: \"0f556d50-37cb-4f6f-ab10-28f4b5e4318d\") " pod="openshift-dns/node-resolver-5mbgg"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903755    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f556d50-37cb-4f6f-ab10-28f4b5e4318d-tmp-dir\") pod \"node-resolver-5mbgg\" (UID: \"0f556d50-37cb-4f6f-ab10-28f4b5e4318d\") " pod="openshift-dns/node-resolver-5mbgg"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwdtp\" (UniqueName: \"kubernetes.io/projected/0f556d50-37cb-4f6f-ab10-28f4b5e4318d-kube-api-access-lwdtp\") pod \"node-resolver-5mbgg\" (UID: \"0f556d50-37cb-4f6f-ab10-28f4b5e4318d\") " pod="openshift-dns/node-resolver-5mbgg"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbcks\" (UniqueName: \"kubernetes.io/projected/57041bdb-e9e0-4912-8437-8aec52acdcc6-kube-api-access-xbcks\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903821    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/118b9d1b-1958-44a7-a291-ed765a1ff95b-ovnkube-script-lib\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12aecb57-1243-492c-9f94-cadbcafa4b5f-kubelet-config\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-kubernetes\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903958    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-cni-bin\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903981    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57041bdb-e9e0-4912-8437-8aec52acdcc6-system-cni-dir\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.903981    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-run-netns\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-systemd\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/118b9d1b-1958-44a7-a291-ed765a1ff95b-env-overrides\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57041bdb-e9e0-4912-8437-8aec52acdcc6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-run-systemd\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/118b9d1b-1958-44a7-a291-ed765a1ff95b-ovn-node-metrics-cert\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9l4x\" (UniqueName: \"kubernetes.io/projected/f4862d09-2821-4eef-84ef-b9c93c75030b-kube-api-access-j9l4x\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-cnibin\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.905636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-multus-socket-dir-parent\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57041bdb-e9e0-4912-8437-8aec52acdcc6-cnibin\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904527    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57041bdb-e9e0-4912-8437-8aec52acdcc6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-hostroot\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-sysconfig\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-var-lib-cni-multus\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-kubelet\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904635    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-run-openvswitch\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904834    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-node-log\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904873    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.904910    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-log-socket\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.905050    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57041bdb-e9e0-4912-8437-8aec52acdcc6-cni-binary-copy\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.905128    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-systemd-units\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.905183    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-run-ovn\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.905234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-run-systemd\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.905425    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/118b9d1b-1958-44a7-a291-ed765a1ff95b-host-cni-netd\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.905667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/118b9d1b-1958-44a7-a291-ed765a1ff95b-env-overrides\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.906313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.905676    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57041bdb-e9e0-4912-8437-8aec52acdcc6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.907255 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.905729    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57041bdb-e9e0-4912-8437-8aec52acdcc6-cnibin\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:30.907255 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.905877    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/beb433e1-340e-4e3d-bced-322403fe86c9-serviceca\") pod \"node-ca-lr5ls\" (UID: \"beb433e1-340e-4e3d-bced-322403fe86c9\") " pod="openshift-image-registry/node-ca-lr5ls"
Jul 20 13:38:30.907255 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.905949    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 13:38:30.907255 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.906067    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bqr7g"
Jul 20 13:38:30.910087 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.910031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/118b9d1b-1958-44a7-a291-ed765a1ff95b-ovn-node-metrics-cert\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.918329 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.918298    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bqr7g"
Jul 20 13:38:30.922902 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.922874    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tlbt\" (UniqueName: \"kubernetes.io/projected/beb433e1-340e-4e3d-bced-322403fe86c9-kube-api-access-7tlbt\") pod \"node-ca-lr5ls\" (UID: \"beb433e1-340e-4e3d-bced-322403fe86c9\") " pod="openshift-image-registry/node-ca-lr5ls"
Jul 20 13:38:30.925583 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.925557    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6ppd\" (UniqueName: \"kubernetes.io/projected/118b9d1b-1958-44a7-a291-ed765a1ff95b-kube-api-access-w6ppd\") pod \"ovnkube-node-pk7fg\" (UID: \"118b9d1b-1958-44a7-a291-ed765a1ff95b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:30.925583 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:30.925570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbcks\" (UniqueName: \"kubernetes.io/projected/57041bdb-e9e0-4912-8437-8aec52acdcc6-kube-api-access-xbcks\") pod \"multus-additional-cni-plugins-w578t\" (UID: \"57041bdb-e9e0-4912-8437-8aec52acdcc6\") " pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:31.005953 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.005908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-hostroot\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.005953 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.005956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-sysconfig\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.006248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.005983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-var-lib-cni-multus\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.006248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-597pp\" (UniqueName: \"kubernetes.io/projected/cf35963e-8fbe-4e77-9e64-1d7d857b0758-kube-api-access-597pp\") pod \"iptables-alerter-fb9tn\" (UID: \"cf35963e-8fbe-4e77-9e64-1d7d857b0758\") " pod="openshift-network-operator/iptables-alerter-fb9tn"
Jul 20 13:38:31.006248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:31.006248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-var-lib-kubelet\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.006248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpw8d\" (UniqueName: \"kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d\") pod \"network-check-target-vq2hf\" (UID: \"4b71405d-76e4-468b-bfcc-51b2e5550ca2\") " pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:31.006248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-modprobe-d\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.006248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-lib-modules\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.006248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plmfc\" (UniqueName: \"kubernetes.io/projected/72c0fcdd-9c9b-451d-94f9-511d42be0132-kube-api-access-plmfc\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.006248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cf35963e-8fbe-4e77-9e64-1d7d857b0758-iptables-alerter-script\") pod \"iptables-alerter-fb9tn\" (UID: \"cf35963e-8fbe-4e77-9e64-1d7d857b0758\") " pod="openshift-network-operator/iptables-alerter-fb9tn"
Jul 20 13:38:31.006248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006198    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-run-multus-certs\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.006248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68nhd\" (UniqueName: \"kubernetes.io/projected/319a2633-83bc-45e4-8b3b-b7ff8237f628-kube-api-access-68nhd\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.006248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-etc-selinux\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-sys-fs\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf35963e-8fbe-4e77-9e64-1d7d857b0758-host-slash\") pod \"iptables-alerter-fb9tn\" (UID: \"cf35963e-8fbe-4e77-9e64-1d7d857b0758\") " pod="openshift-network-operator/iptables-alerter-fb9tn"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-run-netns\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-var-lib-kubelet\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006331    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-tuned\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-socket-dir\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006363    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-device-dir\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3280b00c-71b5-4dd0-b683-3a8560f70c83-multus-daemon-config\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-etc-kubernetes\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-sysctl-conf\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-multus-cni-dir\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-os-release\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-run-k8s-cni-cncf-io\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-run\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-var-lib-cni-bin\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.006884 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-host\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/319a2633-83bc-45e4-8b3b-b7ff8237f628-tmp\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-sysctl-d\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006737    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-sys\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12aecb57-1243-492c-9f94-cadbcafa4b5f-dbus\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-registration-dir\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006812    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-hostroot\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3280b00c-71b5-4dd0-b683-3a8560f70c83-cni-binary-copy\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-multus-conf-dir\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vzk\" (UniqueName: \"kubernetes.io/projected/3280b00c-71b5-4dd0-b683-3a8560f70c83-kube-api-access-n8vzk\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6af5b675-8ee7-4c41-9e90-6497f9c3e88d-konnectivity-ca\") pod \"konnectivity-agent-z9m75\" (UID: \"6af5b675-8ee7-4c41-9e90-6497f9c3e88d\") " pod="kube-system/konnectivity-agent-z9m75"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-system-cni-dir\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006960    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6af5b675-8ee7-4c41-9e90-6497f9c3e88d-agent-certs\") pod \"konnectivity-agent-z9m75\" (UID: \"6af5b675-8ee7-4c41-9e90-6497f9c3e88d\") " pod="kube-system/konnectivity-agent-z9m75"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.006982    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0f556d50-37cb-4f6f-ab10-28f4b5e4318d-hosts-file\") pod \"node-resolver-5mbgg\" (UID: \"0f556d50-37cb-4f6f-ab10-28f4b5e4318d\") " pod="openshift-dns/node-resolver-5mbgg"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f556d50-37cb-4f6f-ab10-28f4b5e4318d-tmp-dir\") pod \"node-resolver-5mbgg\" (UID: \"0f556d50-37cb-4f6f-ab10-28f4b5e4318d\") " pod="openshift-dns/node-resolver-5mbgg"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwdtp\" (UniqueName: \"kubernetes.io/projected/0f556d50-37cb-4f6f-ab10-28f4b5e4318d-kube-api-access-lwdtp\") pod \"node-resolver-5mbgg\" (UID: \"0f556d50-37cb-4f6f-ab10-28f4b5e4318d\") " pod="openshift-dns/node-resolver-5mbgg"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12aecb57-1243-492c-9f94-cadbcafa4b5f-kubelet-config\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-kubernetes\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.007752 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-systemd\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9l4x\" (UniqueName: \"kubernetes.io/projected/f4862d09-2821-4eef-84ef-b9c93c75030b-kube-api-access-j9l4x\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-cnibin\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-multus-socket-dir-parent\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007251    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-sysctl-conf\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007319    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-sysconfig\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007368    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-var-lib-cni-multus\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007399    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-multus-socket-dir-parent\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007404    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3280b00c-71b5-4dd0-b683-3a8560f70c83-cni-binary-copy\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-host\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.007559    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.007638    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret podName:12aecb57-1243-492c-9f94-cadbcafa4b5f nodeName:}" failed. No retries permitted until 2026-07-20 13:38:31.507615487 +0000 UTC m=+3.055186854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret") pod "global-pull-secret-syncer-82vx5" (UID: "12aecb57-1243-492c-9f94-cadbcafa4b5f") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-etc-selinux\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007838    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-var-lib-kubelet\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007877    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf35963e-8fbe-4e77-9e64-1d7d857b0758-host-slash\") pod \"iptables-alerter-fb9tn\" (UID: \"cf35963e-8fbe-4e77-9e64-1d7d857b0758\") " pod="openshift-network-operator/iptables-alerter-fb9tn"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007880    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-run-netns\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007930    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-os-release\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007963    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-run-k8s-cni-cncf-io\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.008611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007986    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-var-lib-cni-bin\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.008013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-multus-cni-dir\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.008065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-run\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.008114    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-var-lib-kubelet\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.008198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-modprobe-d\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.008268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-lib-modules\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.008655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-sysctl-d\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.008828    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-socket-dir\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.008896    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-device-dir\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.008906    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-sys\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.008928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cf35963e-8fbe-4e77-9e64-1d7d857b0758-iptables-alerter-script\") pod \"iptables-alerter-fb9tn\" (UID: \"cf35963e-8fbe-4e77-9e64-1d7d857b0758\") " pod="openshift-network-operator/iptables-alerter-fb9tn"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.008973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12aecb57-1243-492c-9f94-cadbcafa4b5f-dbus\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.008993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-host-run-multus-certs\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.009040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-multus-conf-dir\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.009049    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.009104    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs podName:f4862d09-2821-4eef-84ef-b9c93c75030b nodeName:}" failed. No retries permitted until 2026-07-20 13:38:31.509085377 +0000 UTC m=+3.056656742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs") pod "network-metrics-daemon-q4n2d" (UID: "f4862d09-2821-4eef-84ef-b9c93c75030b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.009158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-registration-dir\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.009533 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.009483    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-etc-kubernetes\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.010299 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.009558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.010299 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.009669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12aecb57-1243-492c-9f94-cadbcafa4b5f-kubelet-config\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:31.010299 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.009726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-system-cni-dir\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.010299 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.009733    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6af5b675-8ee7-4c41-9e90-6497f9c3e88d-konnectivity-ca\") pod \"konnectivity-agent-z9m75\" (UID: \"6af5b675-8ee7-4c41-9e90-6497f9c3e88d\") " pod="kube-system/konnectivity-agent-z9m75"
Jul 20 13:38:31.010299 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.009786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-kubernetes\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.010299 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.009791    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0f556d50-37cb-4f6f-ab10-28f4b5e4318d-hosts-file\") pod \"node-resolver-5mbgg\" (UID: \"0f556d50-37cb-4f6f-ab10-28f4b5e4318d\") " pod="openshift-dns/node-resolver-5mbgg"
Jul 20 13:38:31.010299 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.009812    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3280b00c-71b5-4dd0-b683-3a8560f70c83-cnibin\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.010299 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.009879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-systemd\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.010299 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.009901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3280b00c-71b5-4dd0-b683-3a8560f70c83-multus-daemon-config\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.010299 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.010086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f556d50-37cb-4f6f-ab10-28f4b5e4318d-tmp-dir\") pod \"node-resolver-5mbgg\" (UID: \"0f556d50-37cb-4f6f-ab10-28f4b5e4318d\") " pod="openshift-dns/node-resolver-5mbgg"
Jul 20 13:38:31.010299 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.007841    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72c0fcdd-9c9b-451d-94f9-511d42be0132-sys-fs\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.010797 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.010383    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/319a2633-83bc-45e4-8b3b-b7ff8237f628-tmp\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.010852 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.010824    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/319a2633-83bc-45e4-8b3b-b7ff8237f628-etc-tuned\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.012708 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.012672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6af5b675-8ee7-4c41-9e90-6497f9c3e88d-agent-certs\") pod \"konnectivity-agent-z9m75\" (UID: \"6af5b675-8ee7-4c41-9e90-6497f9c3e88d\") " pod="kube-system/konnectivity-agent-z9m75"
Jul 20 13:38:31.021399 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.021328    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:31.021399 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.021363    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:31.021399 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.021379    2563 projected.go:196] Error preparing data for projected volume kube-api-access-gpw8d for pod openshift-network-diagnostics/network-check-target-vq2hf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:31.021684 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.021494    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d podName:4b71405d-76e4-468b-bfcc-51b2e5550ca2 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:31.521470889 +0000 UTC m=+3.069042259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gpw8d" (UniqueName: "kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d") pod "network-check-target-vq2hf" (UID: "4b71405d-76e4-468b-bfcc-51b2e5550ca2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:31.025443 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.025413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8vzk\" (UniqueName: \"kubernetes.io/projected/3280b00c-71b5-4dd0-b683-3a8560f70c83-kube-api-access-n8vzk\") pod \"multus-m5bvt\" (UID: \"3280b00c-71b5-4dd0-b683-3a8560f70c83\") " pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.025918 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.025894    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwdtp\" (UniqueName: \"kubernetes.io/projected/0f556d50-37cb-4f6f-ab10-28f4b5e4318d-kube-api-access-lwdtp\") pod \"node-resolver-5mbgg\" (UID: \"0f556d50-37cb-4f6f-ab10-28f4b5e4318d\") " pod="openshift-dns/node-resolver-5mbgg"
Jul 20 13:38:31.026323 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.026296    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68nhd\" (UniqueName: \"kubernetes.io/projected/319a2633-83bc-45e4-8b3b-b7ff8237f628-kube-api-access-68nhd\") pod \"tuned-bhb2j\" (UID: \"319a2633-83bc-45e4-8b3b-b7ff8237f628\") " pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.026885 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.026857    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-597pp\" (UniqueName: \"kubernetes.io/projected/cf35963e-8fbe-4e77-9e64-1d7d857b0758-kube-api-access-597pp\") pod \"iptables-alerter-fb9tn\" (UID: \"cf35963e-8fbe-4e77-9e64-1d7d857b0758\") " pod="openshift-network-operator/iptables-alerter-fb9tn"
Jul 20 13:38:31.028234 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.028201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9l4x\" (UniqueName: \"kubernetes.io/projected/f4862d09-2821-4eef-84ef-b9c93c75030b-kube-api-access-j9l4x\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:31.029722 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.029667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plmfc\" (UniqueName: \"kubernetes.io/projected/72c0fcdd-9c9b-451d-94f9-511d42be0132-kube-api-access-plmfc\") pod \"aws-ebs-csi-driver-node-bwfj6\" (UID: \"72c0fcdd-9c9b-451d-94f9-511d42be0132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.095851 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.095803    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w578t"
Jul 20 13:38:31.106200 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.106168    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:31.117296 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.117264    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lr5ls"
Jul 20 13:38:31.125729 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.125476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m5bvt"
Jul 20 13:38:31.133698 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.133660    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z9m75"
Jul 20 13:38:31.142548 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.142520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mbgg"
Jul 20 13:38:31.149855 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.149830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bhb2j"
Jul 20 13:38:31.157859 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.157833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6"
Jul 20 13:38:31.164740 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.164716    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fb9tn"
Jul 20 13:38:31.511480 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.511371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:31.511664 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.511488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:31.511664 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.511562    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:31.511664 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.511621    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:31.511664 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.511655    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs podName:f4862d09-2821-4eef-84ef-b9c93c75030b nodeName:}" failed. No retries permitted until 2026-07-20 13:38:32.511630874 +0000 UTC m=+4.059202240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs") pod "network-metrics-daemon-q4n2d" (UID: "f4862d09-2821-4eef-84ef-b9c93c75030b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:31.511933 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.511681    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret podName:12aecb57-1243-492c-9f94-cadbcafa4b5f nodeName:}" failed. No retries permitted until 2026-07-20 13:38:32.511664293 +0000 UTC m=+4.059235658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret") pod "global-pull-secret-syncer-82vx5" (UID: "12aecb57-1243-492c-9f94-cadbcafa4b5f") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:31.612734 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.612686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpw8d\" (UniqueName: \"kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d\") pod \"network-check-target-vq2hf\" (UID: \"4b71405d-76e4-468b-bfcc-51b2e5550ca2\") " pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:31.612893 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.612859    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:31.612893 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.612882    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:31.612893 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.612891    2563 projected.go:196] Error preparing data for projected volume kube-api-access-gpw8d for pod openshift-network-diagnostics/network-check-target-vq2hf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:31.613038 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:31.612946    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d podName:4b71405d-76e4-468b-bfcc-51b2e5550ca2 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:32.612931144 +0000 UTC m=+4.160502508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpw8d" (UniqueName: "kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d") pod "network-check-target-vq2hf" (UID: "4b71405d-76e4-468b-bfcc-51b2e5550ca2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:31.923888 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.923809    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 13:33:31 +0000 UTC" deadline="2028-04-09 07:59:39.4300226 +0000 UTC"
Jul 20 13:38:31.923888 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:31.923845    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15090h21m7.506181253s"
Jul 20 13:38:31.983606 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:31.983575    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb433e1_340e_4e3d_bced_322403fe86c9.slice/crio-02cdf12279e9bfdfe9c412af66e25d55d504a2684f472f80d637cf597c5c5c9c WatchSource:0}: Error finding container 02cdf12279e9bfdfe9c412af66e25d55d504a2684f472f80d637cf597c5c5c9c: Status 404 returned error can't find the container with id 02cdf12279e9bfdfe9c412af66e25d55d504a2684f472f80d637cf597c5c5c9c
Jul 20 13:38:31.984849 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:31.984822    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3280b00c_71b5_4dd0_b683_3a8560f70c83.slice/crio-8c8f59afa88d55f697f346e5a12e67c74432d5a070294efd8011228ae8bdbeb4 WatchSource:0}: Error finding container 8c8f59afa88d55f697f346e5a12e67c74432d5a070294efd8011228ae8bdbeb4: Status 404 returned error can't find the container with id 8c8f59afa88d55f697f346e5a12e67c74432d5a070294efd8011228ae8bdbeb4
Jul 20 13:38:31.986207 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:31.986174    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf35963e_8fbe_4e77_9e64_1d7d857b0758.slice/crio-0f91a67079a6187ef85a42eb5567b5a8aaa28705ebf07cf47beed89c710ef9e2 WatchSource:0}: Error finding container 0f91a67079a6187ef85a42eb5567b5a8aaa28705ebf07cf47beed89c710ef9e2: Status 404 returned error can't find the container with id 0f91a67079a6187ef85a42eb5567b5a8aaa28705ebf07cf47beed89c710ef9e2
Jul 20 13:38:31.989260 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:31.989177    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af5b675_8ee7_4c41_9e90_6497f9c3e88d.slice/crio-ec813dc9e03395bd9ddff47b14adc6fb23441abe82e4016b54bc6ed4fa0a2625 WatchSource:0}: Error finding container ec813dc9e03395bd9ddff47b14adc6fb23441abe82e4016b54bc6ed4fa0a2625: Status 404 returned error can't find the container with id ec813dc9e03395bd9ddff47b14adc6fb23441abe82e4016b54bc6ed4fa0a2625
Jul 20 13:38:31.991184 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:31.990761    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod319a2633_83bc_45e4_8b3b_b7ff8237f628.slice/crio-234683ffc6eb446cee3ee8675f682b8d626de0ca9653f2bc1b1af0be1525372f WatchSource:0}: Error finding container 234683ffc6eb446cee3ee8675f682b8d626de0ca9653f2bc1b1af0be1525372f: Status 404 returned error can't find the container with id 234683ffc6eb446cee3ee8675f682b8d626de0ca9653f2bc1b1af0be1525372f
Jul 20 13:38:31.991785 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:31.991761    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c0fcdd_9c9b_451d_94f9_511d42be0132.slice/crio-5b76a62d78553ce6261f79190bfda80fa462db601e0a5f815150f5f21311d562 WatchSource:0}: Error finding container 5b76a62d78553ce6261f79190bfda80fa462db601e0a5f815150f5f21311d562: Status 404 returned error can't find the container with id 5b76a62d78553ce6261f79190bfda80fa462db601e0a5f815150f5f21311d562
Jul 20 13:38:31.993405 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:31.993379    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f556d50_37cb_4f6f_ab10_28f4b5e4318d.slice/crio-e7dba61169ed4b9c554771131f7e838c4e84630b12f354422cfb01ea2f5c720e WatchSource:0}: Error finding container e7dba61169ed4b9c554771131f7e838c4e84630b12f354422cfb01ea2f5c720e: Status 404 returned error can't find the container with id e7dba61169ed4b9c554771131f7e838c4e84630b12f354422cfb01ea2f5c720e
Jul 20 13:38:31.994016 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:38:31.993982    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57041bdb_e9e0_4912_8437_8aec52acdcc6.slice/crio-7e47d46c72137a896c2e524a6f93683b1ec3c2d745f2b4ef31fa12a2ba11e7c8 WatchSource:0}: Error finding container 7e47d46c72137a896c2e524a6f93683b1ec3c2d745f2b4ef31fa12a2ba11e7c8: Status 404 returned error can't find the container with id 7e47d46c72137a896c2e524a6f93683b1ec3c2d745f2b4ef31fa12a2ba11e7c8
Jul 20 13:38:32.521298 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:32.521017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:32.521498 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:32.521364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:32.521498 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:32.521202    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:32.521498 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:32.521489    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret podName:12aecb57-1243-492c-9f94-cadbcafa4b5f nodeName:}" failed. No retries permitted until 2026-07-20 13:38:34.521462865 +0000 UTC m=+6.069034245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret") pod "global-pull-secret-syncer-82vx5" (UID: "12aecb57-1243-492c-9f94-cadbcafa4b5f") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:32.521669 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:32.521507    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:32.521669 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:32.521565    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs podName:f4862d09-2821-4eef-84ef-b9c93c75030b nodeName:}" failed. No retries permitted until 2026-07-20 13:38:34.521546522 +0000 UTC m=+6.069117901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs") pod "network-metrics-daemon-q4n2d" (UID: "f4862d09-2821-4eef-84ef-b9c93c75030b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:32.622899 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:32.622146    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpw8d\" (UniqueName: \"kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d\") pod \"network-check-target-vq2hf\" (UID: \"4b71405d-76e4-468b-bfcc-51b2e5550ca2\") " pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:32.622899 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:32.622370    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:32.622899 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:32.622395    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:32.622899 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:32.622411    2563 projected.go:196] Error preparing data for projected volume kube-api-access-gpw8d for pod openshift-network-diagnostics/network-check-target-vq2hf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:32.622899 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:32.622501    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d podName:4b71405d-76e4-468b-bfcc-51b2e5550ca2 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:34.622478996 +0000 UTC m=+6.170050385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpw8d" (UniqueName: "kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d") pod "network-check-target-vq2hf" (UID: "4b71405d-76e4-468b-bfcc-51b2e5550ca2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:32.924180 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:32.924076    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 13:33:31 +0000 UTC" deadline="2027-12-26 12:29:00.910940091 +0000 UTC"
Jul 20 13:38:32.924180 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:32.924124    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12574h50m27.986820679s"
Jul 20 13:38:32.955544 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:32.953631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:32.955544 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:32.953829    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:32.955544 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:32.954369    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:32.955544 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:32.954529    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:32.955544 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:32.954620    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:32.955544 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:32.954745    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:32.977759 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:32.976735    2563 generic.go:356] "Generic (PLEG): container finished" podID="2117fdb9fb6973c962e79220899020b6" containerID="8cca74474031b24baa22349200a20fed4803a25304ce89093c5e243dadd2be74" exitCode=0
Jul 20 13:38:32.977759 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:32.976838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal" event={"ID":"2117fdb9fb6973c962e79220899020b6","Type":"ContainerDied","Data":"8cca74474031b24baa22349200a20fed4803a25304ce89093c5e243dadd2be74"}
Jul 20 13:38:32.993059 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:32.993023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg" event={"ID":"118b9d1b-1958-44a7-a291-ed765a1ff95b","Type":"ContainerStarted","Data":"2d18d09b40f902f235b24bb686f82a0a5a8839340ef583ec3dd713b3f88471e1"}
Jul 20 13:38:33.026374 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:33.026328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w578t" event={"ID":"57041bdb-e9e0-4912-8437-8aec52acdcc6","Type":"ContainerStarted","Data":"7e47d46c72137a896c2e524a6f93683b1ec3c2d745f2b4ef31fa12a2ba11e7c8"}
Jul 20 13:38:33.052171 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:33.052126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mbgg" event={"ID":"0f556d50-37cb-4f6f-ab10-28f4b5e4318d","Type":"ContainerStarted","Data":"e7dba61169ed4b9c554771131f7e838c4e84630b12f354422cfb01ea2f5c720e"}
Jul 20 13:38:33.059537 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:33.057990    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6" event={"ID":"72c0fcdd-9c9b-451d-94f9-511d42be0132","Type":"ContainerStarted","Data":"5b76a62d78553ce6261f79190bfda80fa462db601e0a5f815150f5f21311d562"}
Jul 20 13:38:33.060325 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:33.060145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z9m75" event={"ID":"6af5b675-8ee7-4c41-9e90-6497f9c3e88d","Type":"ContainerStarted","Data":"ec813dc9e03395bd9ddff47b14adc6fb23441abe82e4016b54bc6ed4fa0a2625"}
Jul 20 13:38:33.082496 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:33.082378    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lr5ls" event={"ID":"beb433e1-340e-4e3d-bced-322403fe86c9","Type":"ContainerStarted","Data":"02cdf12279e9bfdfe9c412af66e25d55d504a2684f472f80d637cf597c5c5c9c"}
Jul 20 13:38:33.103709 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:33.103671    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-120.ec2.internal" event={"ID":"90da8d909eb6fafa78270e85990e7272","Type":"ContainerStarted","Data":"fac238c13c3dea7a3c5d514da6807376346ca7ac119924561dfd628fac97d5ee"}
Jul 20 13:38:33.118731 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:33.118662    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-120.ec2.internal" podStartSLOduration=3.118637459 podStartE2EDuration="3.118637459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:33.118607589 +0000 UTC m=+4.666178977" watchObservedRunningTime="2026-07-20 13:38:33.118637459 +0000 UTC m=+4.666208849"
Jul 20 13:38:33.123868 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:33.123801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bhb2j" event={"ID":"319a2633-83bc-45e4-8b3b-b7ff8237f628","Type":"ContainerStarted","Data":"234683ffc6eb446cee3ee8675f682b8d626de0ca9653f2bc1b1af0be1525372f"}
Jul 20 13:38:33.136160 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:33.136112    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fb9tn" event={"ID":"cf35963e-8fbe-4e77-9e64-1d7d857b0758","Type":"ContainerStarted","Data":"0f91a67079a6187ef85a42eb5567b5a8aaa28705ebf07cf47beed89c710ef9e2"}
Jul 20 13:38:33.150734 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:33.150686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m5bvt" event={"ID":"3280b00c-71b5-4dd0-b683-3a8560f70c83","Type":"ContainerStarted","Data":"8c8f59afa88d55f697f346e5a12e67c74432d5a070294efd8011228ae8bdbeb4"}
Jul 20 13:38:34.175447 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:34.175404    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal" event={"ID":"2117fdb9fb6973c962e79220899020b6","Type":"ContainerStarted","Data":"30263928a9fc6473525c5c4c782e393b0d532acfc6d4a8001f8d3a67d63c7fed"}
Jul 20 13:38:34.195171 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:34.195102    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-120.ec2.internal" podStartSLOduration=4.195077511 podStartE2EDuration="4.195077511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:34.194765785 +0000 UTC m=+5.742337175" watchObservedRunningTime="2026-07-20 13:38:34.195077511 +0000 UTC m=+5.742648894"
Jul 20 13:38:34.541829 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:34.540900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:34.541829 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:34.540978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:34.541829 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:34.541161    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:34.541829 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:34.541228    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs podName:f4862d09-2821-4eef-84ef-b9c93c75030b nodeName:}" failed. No retries permitted until 2026-07-20 13:38:38.541206566 +0000 UTC m=+10.088777938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs") pod "network-metrics-daemon-q4n2d" (UID: "f4862d09-2821-4eef-84ef-b9c93c75030b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:34.541829 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:34.541660    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:34.541829 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:34.541716    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret podName:12aecb57-1243-492c-9f94-cadbcafa4b5f nodeName:}" failed. No retries permitted until 2026-07-20 13:38:38.541700633 +0000 UTC m=+10.089272003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret") pod "global-pull-secret-syncer-82vx5" (UID: "12aecb57-1243-492c-9f94-cadbcafa4b5f") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:34.642348 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:34.642283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpw8d\" (UniqueName: \"kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d\") pod \"network-check-target-vq2hf\" (UID: \"4b71405d-76e4-468b-bfcc-51b2e5550ca2\") " pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:34.642667 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:34.642647    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:34.642750 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:34.642679    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:34.642750 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:34.642697    2563 projected.go:196] Error preparing data for projected volume kube-api-access-gpw8d for pod openshift-network-diagnostics/network-check-target-vq2hf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:34.642855 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:34.642766    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d podName:4b71405d-76e4-468b-bfcc-51b2e5550ca2 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:38.642747049 +0000 UTC m=+10.190318416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpw8d" (UniqueName: "kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d") pod "network-check-target-vq2hf" (UID: "4b71405d-76e4-468b-bfcc-51b2e5550ca2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:34.943017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:34.942882    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:34.943212 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:34.943039    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:34.943454 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:34.943431    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:34.943873 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:34.943846    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:34.943977 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:34.943911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:34.944037 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:34.943996    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:36.940953 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:36.940912    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:36.941426 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:36.941070    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:36.941426 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:36.941159    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:36.941426 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:36.941226    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:36.941426 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:36.941288    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:36.941426 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:36.941342    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:38.579175 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:38.579135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:38.579685 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:38.579217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:38.579685 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:38.579358    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:38.579685 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:38.579450    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs podName:f4862d09-2821-4eef-84ef-b9c93c75030b nodeName:}" failed. No retries permitted until 2026-07-20 13:38:46.579430153 +0000 UTC m=+18.127001519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs") pod "network-metrics-daemon-q4n2d" (UID: "f4862d09-2821-4eef-84ef-b9c93c75030b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:38.579853 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:38.579832    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:38.579906 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:38.579870    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret podName:12aecb57-1243-492c-9f94-cadbcafa4b5f nodeName:}" failed. No retries permitted until 2026-07-20 13:38:46.579859239 +0000 UTC m=+18.127430605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret") pod "global-pull-secret-syncer-82vx5" (UID: "12aecb57-1243-492c-9f94-cadbcafa4b5f") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:38.679638 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:38.679587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpw8d\" (UniqueName: \"kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d\") pod \"network-check-target-vq2hf\" (UID: \"4b71405d-76e4-468b-bfcc-51b2e5550ca2\") " pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:38.679821 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:38.679760    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:38.679821 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:38.679792    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:38.679821 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:38.679806    2563 projected.go:196] Error preparing data for projected volume kube-api-access-gpw8d for pod openshift-network-diagnostics/network-check-target-vq2hf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:38.679979 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:38.679870    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d podName:4b71405d-76e4-468b-bfcc-51b2e5550ca2 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:46.679854486 +0000 UTC m=+18.227425853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpw8d" (UniqueName: "kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d") pod "network-check-target-vq2hf" (UID: "4b71405d-76e4-468b-bfcc-51b2e5550ca2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:38.944210 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:38.944130    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:38.944363 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:38.944240    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:38.944363 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:38.944288    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:38.944363 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:38.944338    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:38.944525 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:38.944365    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:38.944525 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:38.944451    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:40.941000 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:40.940580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:40.941000 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:40.940731    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:40.941000 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:40.940813    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:40.941000 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:40.940886    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:40.941000 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:40.940925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:40.941000 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:40.940970    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:42.940435 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:42.940381    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:42.940949 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:42.940512    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:42.940949 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:42.940390    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:42.940949 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:42.940548    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:42.940949 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:42.940662    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:42.940949 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:42.940760    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:44.940154 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:44.940121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:44.940154 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:44.940140    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:44.940751 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:44.940242    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:44.940751 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:44.940329    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:44.940751 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:44.940389    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:44.940751 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:44.940498    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:46.644684 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:46.644641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:46.645229 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:46.644710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:46.645229 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:46.644811    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:46.645229 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:46.644891    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs podName:f4862d09-2821-4eef-84ef-b9c93c75030b nodeName:}" failed. No retries permitted until 2026-07-20 13:39:02.64487303 +0000 UTC m=+34.192444392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs") pod "network-metrics-daemon-q4n2d" (UID: "f4862d09-2821-4eef-84ef-b9c93c75030b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:46.645229 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:46.644825    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:46.645229 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:46.644965    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret podName:12aecb57-1243-492c-9f94-cadbcafa4b5f nodeName:}" failed. No retries permitted until 2026-07-20 13:39:02.644950066 +0000 UTC m=+34.192521435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret") pod "global-pull-secret-syncer-82vx5" (UID: "12aecb57-1243-492c-9f94-cadbcafa4b5f") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:46.745296 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:46.745252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpw8d\" (UniqueName: \"kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d\") pod \"network-check-target-vq2hf\" (UID: \"4b71405d-76e4-468b-bfcc-51b2e5550ca2\") " pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:46.745505 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:46.745432    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:46.745505 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:46.745448    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:46.745505 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:46.745458    2563 projected.go:196] Error preparing data for projected volume kube-api-access-gpw8d for pod openshift-network-diagnostics/network-check-target-vq2hf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:46.745654 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:46.745524    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d podName:4b71405d-76e4-468b-bfcc-51b2e5550ca2 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:02.74550647 +0000 UTC m=+34.293077835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpw8d" (UniqueName: "kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d") pod "network-check-target-vq2hf" (UID: "4b71405d-76e4-468b-bfcc-51b2e5550ca2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:46.941177 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:46.941093    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:46.941177 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:46.941113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:46.941391 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:46.941094    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:46.941391 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:46.941228    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:46.941391 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:46.941288    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:46.941391 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:46.941374    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:48.942147 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:48.941675    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:48.942147 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:48.941737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:48.942147 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:48.941821    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:48.942147 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:48.941900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:48.942147 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:48.942026    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:48.942147 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:48.942112    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:50.940313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:50.940277    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:50.940885 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:50.940283    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:50.940885 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:50.940421    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:50.940885 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:50.940430    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:50.940885 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:50.940567    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:50.940885 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:50.940652    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:52.230691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.229910    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg" event={"ID":"118b9d1b-1958-44a7-a291-ed765a1ff95b","Type":"ContainerStarted","Data":"b6e6cfd683deb02df54d707271ad37b1e4967a9357561e79c2fdb2fbd932edd7"}
Jul 20 13:38:52.230691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.230454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg" event={"ID":"118b9d1b-1958-44a7-a291-ed765a1ff95b","Type":"ContainerStarted","Data":"78575045a36ad771c31d1112413899c7578bb36a71f954aa0f5b08aa4881ea13"}
Jul 20 13:38:52.230691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.230544    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg" event={"ID":"118b9d1b-1958-44a7-a291-ed765a1ff95b","Type":"ContainerStarted","Data":"f4fcfe0460b1e447654878f621633a19d33070c24ad7058bc3bbb6a3ad265f50"}
Jul 20 13:38:52.230691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.230580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg" event={"ID":"118b9d1b-1958-44a7-a291-ed765a1ff95b","Type":"ContainerStarted","Data":"0996b3bf0532880792a952fd0338180cad213e5585bc73b84dd01880dda706f1"}
Jul 20 13:38:52.230691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.230626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg" event={"ID":"118b9d1b-1958-44a7-a291-ed765a1ff95b","Type":"ContainerStarted","Data":"0881293e103001a83f71c747ec298af53ecca6980f7586866f9ab5e16397ef04"}
Jul 20 13:38:52.231558 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.231506    2563 generic.go:356] "Generic (PLEG): container finished" podID="57041bdb-e9e0-4912-8437-8aec52acdcc6" containerID="2ff02aadf75e9de2856940a8ea784e5ad3d256d8addeb2837befcc3e1a146f92" exitCode=0
Jul 20 13:38:52.231613 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.231590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w578t" event={"ID":"57041bdb-e9e0-4912-8437-8aec52acdcc6","Type":"ContainerDied","Data":"2ff02aadf75e9de2856940a8ea784e5ad3d256d8addeb2837befcc3e1a146f92"}
Jul 20 13:38:52.233355 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.233328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mbgg" event={"ID":"0f556d50-37cb-4f6f-ab10-28f4b5e4318d","Type":"ContainerStarted","Data":"fc4e7cc2a734e2d184dd5077b3593023803598833be77c6c3347abfed0cc9943"}
Jul 20 13:38:52.234874 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.234856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6" event={"ID":"72c0fcdd-9c9b-451d-94f9-511d42be0132","Type":"ContainerStarted","Data":"9c90ece4cc233147645c8e199f81a9aa448439bddcb3c28cc82e32b936ec12fa"}
Jul 20 13:38:52.236157 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.236107    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z9m75" event={"ID":"6af5b675-8ee7-4c41-9e90-6497f9c3e88d","Type":"ContainerStarted","Data":"c19aa96952fe185184ed2d7a9bd983a9e1d267da23ce7fe7baa4fecd861ae266"}
Jul 20 13:38:52.237460 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.237440    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lr5ls" event={"ID":"beb433e1-340e-4e3d-bced-322403fe86c9","Type":"ContainerStarted","Data":"95a3045dabbf34227485f1e0287a05c52d33ddfb7cfcde1e0aa21bfc679ac297"}
Jul 20 13:38:52.239156 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.239138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bhb2j" event={"ID":"319a2633-83bc-45e4-8b3b-b7ff8237f628","Type":"ContainerStarted","Data":"4490b28b205d2a39a09a5c5c68dfe34088a48c8bd86f6f6aba2e7542507399ba"}
Jul 20 13:38:52.240443 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.240424    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m5bvt" event={"ID":"3280b00c-71b5-4dd0-b683-3a8560f70c83","Type":"ContainerStarted","Data":"fadbf39fc3e3b812e868e3a09527ac0e9a4a900dd14f352e24c3302c584028c0"}
Jul 20 13:38:52.277836 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.277787    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m5bvt" podStartSLOduration=3.619668859 podStartE2EDuration="23.277772143s" totalImagesPullingTime="19.658103284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:52.277335784 +0000 UTC m=+23.824907170" watchObservedRunningTime="2026-07-20 13:38:52.277772143 +0000 UTC m=+23.825343528"
Jul 20 13:38:52.291670 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.291616    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z9m75" podStartSLOduration=11.831510939 podStartE2EDuration="23.291599858s" totalImagesPullingTime="11.460088919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:52.29112322 +0000 UTC m=+23.838694618" watchObservedRunningTime="2026-07-20 13:38:52.291599858 +0000 UTC m=+23.839171243"
Jul 20 13:38:52.306034 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.305992    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5mbgg" podStartSLOduration=3.709125541 podStartE2EDuration="23.305977426s" totalImagesPullingTime="19.596851885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:52.305430581 +0000 UTC m=+23.853001970" watchObservedRunningTime="2026-07-20 13:38:52.305977426 +0000 UTC m=+23.853548810"
Jul 20 13:38:52.326876 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.326813    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bhb2j" podStartSLOduration=3.723911196 podStartE2EDuration="23.326798058s" totalImagesPullingTime="19.602886862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:52.326628811 +0000 UTC m=+23.874200196" watchObservedRunningTime="2026-07-20 13:38:52.326798058 +0000 UTC m=+23.874369443"
Jul 20 13:38:52.351220 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.351173    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lr5ls" podStartSLOduration=3.7438172180000002 podStartE2EDuration="23.351156808s" totalImagesPullingTime="19.60733959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:52.350868133 +0000 UTC m=+23.898439518" watchObservedRunningTime="2026-07-20 13:38:52.351156808 +0000 UTC m=+23.898728194"
Jul 20 13:38:52.940248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.940171    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:52.940248 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.940208    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:52.940516 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:52.940171    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:52.940516 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:52.940308    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:52.940516 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:52.940359    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:52.940516 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:52.940482    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:53.219419 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:53.219373    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 13:38:53.245320 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:53.245282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6" event={"ID":"72c0fcdd-9c9b-451d-94f9-511d42be0132","Type":"ContainerStarted","Data":"eae00714cd7ac8959bfeb10044e2aa359b347a3288bc7ce51cb2256be7d7c6be"}
Jul 20 13:38:53.246859 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:53.246831    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fb9tn" event={"ID":"cf35963e-8fbe-4e77-9e64-1d7d857b0758","Type":"ContainerStarted","Data":"5429956faf335f2bfa9bea0852b166f8284f289b181d257b271d273ab34d7cdd"}
Jul 20 13:38:53.250283 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:53.250256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg" event={"ID":"118b9d1b-1958-44a7-a291-ed765a1ff95b","Type":"ContainerStarted","Data":"8ca41151e646a7f547dbcf8eaaa1c0ce3d7e91a01de94ab3f49ad7e39c7dcd4f"}
Jul 20 13:38:53.262441 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:53.262377    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fb9tn" podStartSLOduration=4.657075667 podStartE2EDuration="24.262363569s" totalImagesPullingTime="19.605287902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:53.262124555 +0000 UTC m=+24.809695944" watchObservedRunningTime="2026-07-20 13:38:53.262363569 +0000 UTC m=+24.809934955"
Jul 20 13:38:53.322728 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:53.322680    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z9m75"
Jul 20 13:38:53.323333 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:53.323315    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z9m75"
Jul 20 13:38:53.855199 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:53.855102    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T13:38:53.219393933Z","UUID":"3d4b9a71-be69-40d3-b89d-451befb591a9","Handler":null,"Name":"","Endpoint":""}
Jul 20 13:38:53.856699 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:53.856676    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 13:38:53.856812 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:53.856721    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 13:38:54.940114 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:54.940018    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:54.940114 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:54.940039    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:54.940114 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:54.940042    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:54.940677 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:54.940159    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:54.940677 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:54.940291    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:54.940677 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:54.940381    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:55.259328 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:55.259244    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg" event={"ID":"118b9d1b-1958-44a7-a291-ed765a1ff95b","Type":"ContainerStarted","Data":"3e7ec4a9771a7d55b6c9ebc64e4cc1cc5060878738ad8ba04e3b038ccb889bc7"}
Jul 20 13:38:55.262053 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:55.261979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6" event={"ID":"72c0fcdd-9c9b-451d-94f9-511d42be0132","Type":"ContainerStarted","Data":"63219bbe42b0802ee25749a9144e9a1be13bede31b1bafd6641386bb82508fe7"}
Jul 20 13:38:55.262053 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:55.262018    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 13:38:56.940942 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:56.940640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:56.941396 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:56.940725    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:56.941396 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:56.941015    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:56.941396 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:56.940737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:56.941396 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:56.941095    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:56.941396 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:56.941133    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:57.271457 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:57.271422    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg" event={"ID":"118b9d1b-1958-44a7-a291-ed765a1ff95b","Type":"ContainerStarted","Data":"69dd7e6156f08e18d3fac8361353e53c37fa51c12b5f2aef3af0c32bdc9e2043"}
Jul 20 13:38:57.271749 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:57.271725    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:57.287433 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:57.287376    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:57.297833 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:57.297769    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg" podStartSLOduration=8.627167338 podStartE2EDuration="28.297746938s" totalImagesPullingTime="19.6705796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:57.297239262 +0000 UTC m=+28.844810646" watchObservedRunningTime="2026-07-20 13:38:57.297746938 +0000 UTC m=+28.845318324"
Jul 20 13:38:57.298091 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:57.298061    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwfj6" podStartSLOduration=5.940754102 podStartE2EDuration="28.298052845s" totalImagesPullingTime="22.357298743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:55.281941569 +0000 UTC m=+26.829512953" watchObservedRunningTime="2026-07-20 13:38:57.298052845 +0000 UTC m=+28.845624234"
Jul 20 13:38:58.275201 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:58.275009    2563 generic.go:356] "Generic (PLEG): container finished" podID="57041bdb-e9e0-4912-8437-8aec52acdcc6" containerID="4a3613e6c643179056ee19101c14b513bf78a299ba2306bb284eadeef6c6b267" exitCode=0
Jul 20 13:38:58.275936 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:58.275094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w578t" event={"ID":"57041bdb-e9e0-4912-8437-8aec52acdcc6","Type":"ContainerDied","Data":"4a3613e6c643179056ee19101c14b513bf78a299ba2306bb284eadeef6c6b267"}
Jul 20 13:38:58.275936 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:58.275791    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:58.275936 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:58.275859    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:58.292211 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:58.292183    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:38:58.941106 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:58.941069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:58.941429 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:58.941128    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:58.941429 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:58.941175    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:58.941429 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:58.941247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:58.941429 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:58.941300    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:38:58.941429 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:58.941325    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:59.280215 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:59.280174    2563 generic.go:356] "Generic (PLEG): container finished" podID="57041bdb-e9e0-4912-8437-8aec52acdcc6" containerID="7d603100b54ac592e8f9407be773d9180f0c16bdd7fc46efcca682540b11d933" exitCode=0
Jul 20 13:38:59.280665 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:59.280242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w578t" event={"ID":"57041bdb-e9e0-4912-8437-8aec52acdcc6","Type":"ContainerDied","Data":"7d603100b54ac592e8f9407be773d9180f0c16bdd7fc46efcca682540b11d933"}
Jul 20 13:38:59.458502 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:59.458389    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-82vx5"]
Jul 20 13:38:59.458659 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:59.458598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:38:59.458732 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:59.458711    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:38:59.459172 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:59.459149    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vq2hf"]
Jul 20 13:38:59.459249 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:59.459238    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:38:59.459320 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:59.459304    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:38:59.460298 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:59.460276    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q4n2d"]
Jul 20 13:38:59.460425 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:38:59.460360    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:38:59.460494 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:38:59.460446    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:39:00.320228 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:00.320187    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z9m75"
Jul 20 13:39:00.320701 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:00.320339    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 13:39:00.320857 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:00.320840    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z9m75"
Jul 20 13:39:00.940773 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:00.940698    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:39:00.940935 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:00.940697    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:39:00.940935 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:00.940823    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:39:00.940935 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:00.940692    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:39:00.940935 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:00.940899    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:39:00.941069 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:00.940967    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:39:01.287130 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:01.287091    2563 generic.go:356] "Generic (PLEG): container finished" podID="57041bdb-e9e0-4912-8437-8aec52acdcc6" containerID="881ca3ff8f27e28ed04ca38413a864ac057db7b66b88917ca27a50c56608dde2" exitCode=0
Jul 20 13:39:01.287267 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:01.287183    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w578t" event={"ID":"57041bdb-e9e0-4912-8437-8aec52acdcc6","Type":"ContainerDied","Data":"881ca3ff8f27e28ed04ca38413a864ac057db7b66b88917ca27a50c56608dde2"}
Jul 20 13:39:02.661471 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:02.661432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:39:02.661939 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:02.661494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:39:02.661939 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:02.661614    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:39:02.661939 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:02.661626    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:39:02.661939 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:02.661681    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs podName:f4862d09-2821-4eef-84ef-b9c93c75030b nodeName:}" failed. No retries permitted until 2026-07-20 13:39:34.661663598 +0000 UTC m=+66.209234960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs") pod "network-metrics-daemon-q4n2d" (UID: "f4862d09-2821-4eef-84ef-b9c93c75030b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:39:02.661939 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:02.661700    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret podName:12aecb57-1243-492c-9f94-cadbcafa4b5f nodeName:}" failed. No retries permitted until 2026-07-20 13:39:34.661691056 +0000 UTC m=+66.209262419 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret") pod "global-pull-secret-syncer-82vx5" (UID: "12aecb57-1243-492c-9f94-cadbcafa4b5f") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:39:02.762211 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:02.762124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpw8d\" (UniqueName: \"kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d\") pod \"network-check-target-vq2hf\" (UID: \"4b71405d-76e4-468b-bfcc-51b2e5550ca2\") " pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:39:02.762377 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:02.762261    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:39:02.762377 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:02.762281    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:39:02.762377 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:02.762293    2563 projected.go:196] Error preparing data for projected volume kube-api-access-gpw8d for pod openshift-network-diagnostics/network-check-target-vq2hf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:39:02.762377 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:02.762352    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d podName:4b71405d-76e4-468b-bfcc-51b2e5550ca2 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:34.762335648 +0000 UTC m=+66.309907011 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpw8d" (UniqueName: "kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d") pod "network-check-target-vq2hf" (UID: "4b71405d-76e4-468b-bfcc-51b2e5550ca2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:39:02.940111 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:02.940078    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:39:02.940111 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:02.940100    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:39:02.940320 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:02.940211    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82vx5" podUID="12aecb57-1243-492c-9f94-cadbcafa4b5f"
Jul 20 13:39:02.940320 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:02.940218    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:39:02.940472 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:02.940321    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4n2d" podUID="f4862d09-2821-4eef-84ef-b9c93c75030b"
Jul 20 13:39:02.940519 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:02.940465    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq2hf" podUID="4b71405d-76e4-468b-bfcc-51b2e5550ca2"
Jul 20 13:39:04.263799 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.263777    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-120.ec2.internal" event="NodeReady"
Jul 20 13:39:04.264189 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.263948    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 13:39:04.323918 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.323878    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f9678fb78-fsw84"]
Jul 20 13:39:04.327747 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.327718    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.333093 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.332819    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 13:39:04.333093 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.332858    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 13:39:04.333647 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.333622    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 13:39:04.333746 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.333622    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d6whh\""
Jul 20 13:39:04.338006 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.337987    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 13:39:04.344710 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.344669    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f9678fb78-fsw84"]
Jul 20 13:39:04.359205 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.359178    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nslcs"]
Jul 20 13:39:04.362311 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.362295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nslcs"
Jul 20 13:39:04.365635 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.365537    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 13:39:04.365788 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.365681    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2m9zn\""
Jul 20 13:39:04.365866 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.365841    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 13:39:04.365988 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.365960    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 13:39:04.366503 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.366484    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9l6hd"]
Jul 20 13:39:04.371237 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.370822    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.375518 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.375462    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 13:39:04.375518 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.375503    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 13:39:04.375698 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.375503    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xqm2v\""
Jul 20 13:39:04.376013 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.375992    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 13:39:04.376360 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.376342    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 13:39:04.386421 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.383109    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nslcs"]
Jul 20 13:39:04.392920 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.392888    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9l6hd"]
Jul 20 13:39:04.397698 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.397675    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rpjrt"]
Jul 20 13:39:04.400961 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.400934    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:04.403366 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.403327    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 13:39:04.403577 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.403336    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fbmz6\""
Jul 20 13:39:04.403801 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.403783    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 13:39:04.418603 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.418576    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rpjrt"]
Jul 20 13:39:04.475775 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.475732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87679bd4-e891-47df-95db-3f342730a5b4-ca-trust-extracted\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.475949 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.475783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87679bd4-e891-47df-95db-3f342730a5b4-registry-certificates\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.475949 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.475848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87679bd4-e891-47df-95db-3f342730a5b4-image-registry-private-configuration\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.475949 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.475877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87679bd4-e891-47df-95db-3f342730a5b4-installation-pull-secrets\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.475949 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.475904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh26k\" (UniqueName: \"kubernetes.io/projected/612d1abb-56c1-4cde-be96-56c80194c8df-kube-api-access-zh26k\") pod \"ingress-canary-nslcs\" (UID: \"612d1abb-56c1-4cde-be96-56c80194c8df\") " pod="openshift-ingress-canary/ingress-canary-nslcs"
Jul 20 13:39:04.476111 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.475956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5655a72-6305-49d9-a2c1-04ebcd96660b-crio-socket\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.476111 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.475984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-bound-sa-token\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.476111 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.475998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.476111 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.476024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5h97\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-kube-api-access-c5h97\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.476111 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.476051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg8fd\" (UniqueName: \"kubernetes.io/projected/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-api-access-gg8fd\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.476111 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.476073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87679bd4-e891-47df-95db-3f342730a5b4-trusted-ca\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.476111 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.476092    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.476368 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.476108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5655a72-6305-49d9-a2c1-04ebcd96660b-data-volume\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.476368 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.476173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.476368 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.476197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/612d1abb-56c1-4cde-be96-56c80194c8df-cert\") pod \"ingress-canary-nslcs\" (UID: \"612d1abb-56c1-4cde-be96-56c80194c8df\") " pod="openshift-ingress-canary/ingress-canary-nslcs"
Jul 20 13:39:04.521310 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.521285    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mbgg_0f556d50-37cb-4f6f-ab10-28f4b5e4318d/dns-node-resolver/0.log"
Jul 20 13:39:04.577169 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87679bd4-e891-47df-95db-3f342730a5b4-ca-trust-extracted\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.577355 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87679bd4-e891-47df-95db-3f342730a5b4-registry-certificates\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.577355 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577223    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87679bd4-e891-47df-95db-3f342730a5b4-image-registry-private-configuration\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.577355 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87679bd4-e891-47df-95db-3f342730a5b4-installation-pull-secrets\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.577355 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh26k\" (UniqueName: \"kubernetes.io/projected/612d1abb-56c1-4cde-be96-56c80194c8df-kube-api-access-zh26k\") pod \"ingress-canary-nslcs\" (UID: \"612d1abb-56c1-4cde-be96-56c80194c8df\") " pod="openshift-ingress-canary/ingress-canary-nslcs"
Jul 20 13:39:04.577355 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmgxh\" (UniqueName: \"kubernetes.io/projected/68723171-55ad-486f-9630-cf1ac6b48c5d-kube-api-access-mmgxh\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:04.577355 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68723171-55ad-486f-9630-cf1ac6b48c5d-config-volume\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5655a72-6305-49d9-a2c1-04ebcd96660b-crio-socket\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68723171-55ad-486f-9630-cf1ac6b48c5d-tmp-dir\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-bound-sa-token\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577541    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5h97\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-kube-api-access-c5h97\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg8fd\" (UniqueName: \"kubernetes.io/projected/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-api-access-gg8fd\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87679bd4-e891-47df-95db-3f342730a5b4-trusted-ca\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87679bd4-e891-47df-95db-3f342730a5b4-ca-trust-extracted\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577601    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5655a72-6305-49d9-a2c1-04ebcd96660b-data-volume\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:04.577663    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 13:39:04.577669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/612d1abb-56c1-4cde-be96-56c80194c8df-cert\") pod \"ingress-canary-nslcs\" (UID: \"612d1abb-56c1-4cde-be96-56c80194c8df\") " pod="openshift-ingress-canary/ingress-canary-nslcs"
Jul 20 13:39:04.578295 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:04.577724    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-rbac-proxy-cm podName:a5655a72-6305-49d9-a2c1-04ebcd96660b nodeName:}" failed. No retries permitted until 2026-07-20 13:39:05.077703053 +0000 UTC m=+36.625274422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9l6hd" (UID: "a5655a72-6305-49d9-a2c1-04ebcd96660b") : configmap "kube-rbac-proxy" not found
Jul 20 13:39:04.578295 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5655a72-6305-49d9-a2c1-04ebcd96660b-crio-socket\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.578295 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.577851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87679bd4-e891-47df-95db-3f342730a5b4-registry-certificates\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.578295 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:04.578123    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:04.578295 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:04.578170    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls podName:a5655a72-6305-49d9-a2c1-04ebcd96660b nodeName:}" failed. No retries permitted until 2026-07-20 13:39:05.07815549 +0000 UTC m=+36.625726854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9l6hd" (UID: "a5655a72-6305-49d9-a2c1-04ebcd96660b") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:04.578295 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:04.578248    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:39:04.578295 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:04.578264    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f9678fb78-fsw84: secret "image-registry-tls" not found
Jul 20 13:39:04.578652 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.578297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5655a72-6305-49d9-a2c1-04ebcd96660b-data-volume\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.578652 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:04.578333    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls podName:87679bd4-e891-47df-95db-3f342730a5b4 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:05.078315469 +0000 UTC m=+36.625886836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls") pod "image-registry-6f9678fb78-fsw84" (UID: "87679bd4-e891-47df-95db-3f342730a5b4") : secret "image-registry-tls" not found
Jul 20 13:39:04.578838 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.578817    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87679bd4-e891-47df-95db-3f342730a5b4-trusted-ca\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.582236 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.582213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87679bd4-e891-47df-95db-3f342730a5b4-installation-pull-secrets\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.582337 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.582213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87679bd4-e891-47df-95db-3f342730a5b4-image-registry-private-configuration\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.586779 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.586756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/612d1abb-56c1-4cde-be96-56c80194c8df-cert\") pod \"ingress-canary-nslcs\" (UID: \"612d1abb-56c1-4cde-be96-56c80194c8df\") " pod="openshift-ingress-canary/ingress-canary-nslcs"
Jul 20 13:39:04.593271 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.593243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5h97\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-kube-api-access-c5h97\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.593390 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.593356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg8fd\" (UniqueName: \"kubernetes.io/projected/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-api-access-gg8fd\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:04.593697 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.593676    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh26k\" (UniqueName: \"kubernetes.io/projected/612d1abb-56c1-4cde-be96-56c80194c8df-kube-api-access-zh26k\") pod \"ingress-canary-nslcs\" (UID: \"612d1abb-56c1-4cde-be96-56c80194c8df\") " pod="openshift-ingress-canary/ingress-canary-nslcs"
Jul 20 13:39:04.596558 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.596523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-bound-sa-token\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:04.671170 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.671100    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nslcs"
Jul 20 13:39:04.678096 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.678068    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:04.678222 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.678193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmgxh\" (UniqueName: \"kubernetes.io/projected/68723171-55ad-486f-9630-cf1ac6b48c5d-kube-api-access-mmgxh\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:04.678283 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.678223    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68723171-55ad-486f-9630-cf1ac6b48c5d-config-volume\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:04.678283 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:04.678235    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:39:04.678371 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:04.678305    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls podName:68723171-55ad-486f-9630-cf1ac6b48c5d nodeName:}" failed. No retries permitted until 2026-07-20 13:39:05.1782841 +0000 UTC m=+36.725855467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls") pod "dns-default-rpjrt" (UID: "68723171-55ad-486f-9630-cf1ac6b48c5d") : secret "dns-default-metrics-tls" not found
Jul 20 13:39:04.678371 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.678242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68723171-55ad-486f-9630-cf1ac6b48c5d-tmp-dir\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:04.678553 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.678513    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68723171-55ad-486f-9630-cf1ac6b48c5d-tmp-dir\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:04.678826 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.678806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68723171-55ad-486f-9630-cf1ac6b48c5d-config-volume\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:04.692769 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.692739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmgxh\" (UniqueName: \"kubernetes.io/projected/68723171-55ad-486f-9630-cf1ac6b48c5d-kube-api-access-mmgxh\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:04.831904 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.831872    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-8m254"]
Jul 20 13:39:04.835733 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.835711    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-8m254"
Jul 20 13:39:04.843636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.843614    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 20 13:39:04.843766 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.843682    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 20 13:39:04.843766 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.843615    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 20 13:39:04.843873 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.843803    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-f9nts\""
Jul 20 13:39:04.843965 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.843944    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 20 13:39:04.859184 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.859155    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-8m254"]
Jul 20 13:39:04.940913 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.940816    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:39:04.941080 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.940945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:39:04.941080 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.940993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:39:04.945372 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.945094    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 13:39:04.945372 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.945128    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 13:39:04.945372 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.945147    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 13:39:04.945594 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.945450    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 13:39:04.945594 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.945544    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rd77k\""
Jul 20 13:39:04.945760 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.945744    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpj58\""
Jul 20 13:39:04.981886 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.981851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e0e3c8e-0da9-4b69-81d1-838783f53977-signing-key\") pod \"service-ca-58598695f7-8m254\" (UID: \"1e0e3c8e-0da9-4b69-81d1-838783f53977\") " pod="openshift-service-ca/service-ca-58598695f7-8m254"
Jul 20 13:39:04.982028 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.981950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e0e3c8e-0da9-4b69-81d1-838783f53977-signing-cabundle\") pod \"service-ca-58598695f7-8m254\" (UID: \"1e0e3c8e-0da9-4b69-81d1-838783f53977\") " pod="openshift-service-ca/service-ca-58598695f7-8m254"
Jul 20 13:39:04.982099 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:04.982078    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrjn2\" (UniqueName: \"kubernetes.io/projected/1e0e3c8e-0da9-4b69-81d1-838783f53977-kube-api-access-qrjn2\") pod \"service-ca-58598695f7-8m254\" (UID: \"1e0e3c8e-0da9-4b69-81d1-838783f53977\") " pod="openshift-service-ca/service-ca-58598695f7-8m254"
Jul 20 13:39:05.082951 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:05.082910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrjn2\" (UniqueName: \"kubernetes.io/projected/1e0e3c8e-0da9-4b69-81d1-838783f53977-kube-api-access-qrjn2\") pod \"service-ca-58598695f7-8m254\" (UID: \"1e0e3c8e-0da9-4b69-81d1-838783f53977\") " pod="openshift-service-ca/service-ca-58598695f7-8m254"
Jul 20 13:39:05.082951 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:05.082950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e0e3c8e-0da9-4b69-81d1-838783f53977-signing-key\") pod \"service-ca-58598695f7-8m254\" (UID: \"1e0e3c8e-0da9-4b69-81d1-838783f53977\") " pod="openshift-service-ca/service-ca-58598695f7-8m254"
Jul 20 13:39:05.083190 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:05.082992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:05.083190 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:05.083049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e0e3c8e-0da9-4b69-81d1-838783f53977-signing-cabundle\") pod \"service-ca-58598695f7-8m254\" (UID: \"1e0e3c8e-0da9-4b69-81d1-838783f53977\") " pod="openshift-service-ca/service-ca-58598695f7-8m254"
Jul 20 13:39:05.083190 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:05.083109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:05.083190 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:05.083154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:05.083373 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:05.083255    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:05.083373 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:05.083310    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls podName:a5655a72-6305-49d9-a2c1-04ebcd96660b nodeName:}" failed. No retries permitted until 2026-07-20 13:39:06.083296114 +0000 UTC m=+37.630867477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9l6hd" (UID: "a5655a72-6305-49d9-a2c1-04ebcd96660b") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:05.083840 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:05.083670    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:39:05.083840 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:05.083688    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f9678fb78-fsw84: secret "image-registry-tls" not found
Jul 20 13:39:05.083840 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:05.083731    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls podName:87679bd4-e891-47df-95db-3f342730a5b4 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:06.083718938 +0000 UTC m=+37.631290300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls") pod "image-registry-6f9678fb78-fsw84" (UID: "87679bd4-e891-47df-95db-3f342730a5b4") : secret "image-registry-tls" not found
Jul 20 13:39:05.083840 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:05.083769    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 13:39:05.083840 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:05.083800    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-rbac-proxy-cm podName:a5655a72-6305-49d9-a2c1-04ebcd96660b nodeName:}" failed. No retries permitted until 2026-07-20 13:39:06.083790154 +0000 UTC m=+37.631361516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9l6hd" (UID: "a5655a72-6305-49d9-a2c1-04ebcd96660b") : configmap "kube-rbac-proxy" not found
Jul 20 13:39:05.083840 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:05.083806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e0e3c8e-0da9-4b69-81d1-838783f53977-signing-cabundle\") pod \"service-ca-58598695f7-8m254\" (UID: \"1e0e3c8e-0da9-4b69-81d1-838783f53977\") " pod="openshift-service-ca/service-ca-58598695f7-8m254"
Jul 20 13:39:05.086113 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:05.086092    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e0e3c8e-0da9-4b69-81d1-838783f53977-signing-key\") pod \"service-ca-58598695f7-8m254\" (UID: \"1e0e3c8e-0da9-4b69-81d1-838783f53977\") " pod="openshift-service-ca/service-ca-58598695f7-8m254"
Jul 20 13:39:05.091964 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:05.091945    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrjn2\" (UniqueName: \"kubernetes.io/projected/1e0e3c8e-0da9-4b69-81d1-838783f53977-kube-api-access-qrjn2\") pod \"service-ca-58598695f7-8m254\" (UID: \"1e0e3c8e-0da9-4b69-81d1-838783f53977\") " pod="openshift-service-ca/service-ca-58598695f7-8m254"
Jul 20 13:39:05.145869 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:05.145827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-8m254"
Jul 20 13:39:05.184222 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:05.184178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:05.184396 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:05.184350    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:39:05.184473 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:05.184439    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls podName:68723171-55ad-486f-9630-cf1ac6b48c5d nodeName:}" failed. No retries permitted until 2026-07-20 13:39:06.184422951 +0000 UTC m=+37.731994314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls") pod "dns-default-rpjrt" (UID: "68723171-55ad-486f-9630-cf1ac6b48c5d") : secret "dns-default-metrics-tls" not found
Jul 20 13:39:05.485969 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:05.485940    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lr5ls_beb433e1-340e-4e3d-bced-322403fe86c9/node-ca/0.log"
Jul 20 13:39:06.060103 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:06.059923    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nslcs"]
Jul 20 13:39:06.063458 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:06.063431    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612d1abb_56c1_4cde_be96_56c80194c8df.slice/crio-5a9b8d9856e58fd5d8dfd0e81da57847504603c1287b729f2867202f549c14c8 WatchSource:0}: Error finding container 5a9b8d9856e58fd5d8dfd0e81da57847504603c1287b729f2867202f549c14c8: Status 404 returned error can't find the container with id 5a9b8d9856e58fd5d8dfd0e81da57847504603c1287b729f2867202f549c14c8
Jul 20 13:39:06.066282 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:06.066253    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-8m254"]
Jul 20 13:39:06.095144 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:06.095115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:06.095319 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:06.095158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:06.095319 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:06.095270    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:39:06.095319 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:06.095283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:06.095480 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:06.095291    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f9678fb78-fsw84: secret "image-registry-tls" not found
Jul 20 13:39:06.095480 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:06.095351    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:06.095480 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:06.095329    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 13:39:06.095480 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:06.095420    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls podName:87679bd4-e891-47df-95db-3f342730a5b4 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:08.095383229 +0000 UTC m=+39.642954606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls") pod "image-registry-6f9678fb78-fsw84" (UID: "87679bd4-e891-47df-95db-3f342730a5b4") : secret "image-registry-tls" not found
Jul 20 13:39:06.095480 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:06.095470    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls podName:a5655a72-6305-49d9-a2c1-04ebcd96660b nodeName:}" failed. No retries permitted until 2026-07-20 13:39:08.095454383 +0000 UTC m=+39.643025746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9l6hd" (UID: "a5655a72-6305-49d9-a2c1-04ebcd96660b") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:06.095480 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:06.095483    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-rbac-proxy-cm podName:a5655a72-6305-49d9-a2c1-04ebcd96660b nodeName:}" failed. No retries permitted until 2026-07-20 13:39:08.09547563 +0000 UTC m=+39.643046993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9l6hd" (UID: "a5655a72-6305-49d9-a2c1-04ebcd96660b") : configmap "kube-rbac-proxy" not found
Jul 20 13:39:06.195925 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:06.195891    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:06.196070 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:06.196053    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:39:06.196123 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:06.196117    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls podName:68723171-55ad-486f-9630-cf1ac6b48c5d nodeName:}" failed. No retries permitted until 2026-07-20 13:39:08.196100688 +0000 UTC m=+39.743672052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls") pod "dns-default-rpjrt" (UID: "68723171-55ad-486f-9630-cf1ac6b48c5d") : secret "dns-default-metrics-tls" not found
Jul 20 13:39:06.301508 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:06.301470    2563 generic.go:356] "Generic (PLEG): container finished" podID="57041bdb-e9e0-4912-8437-8aec52acdcc6" containerID="848b0d3cba108352537484169bfb2de31d3a0705091380c70f4290301dd424ba" exitCode=0
Jul 20 13:39:06.301667 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:06.301557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w578t" event={"ID":"57041bdb-e9e0-4912-8437-8aec52acdcc6","Type":"ContainerDied","Data":"848b0d3cba108352537484169bfb2de31d3a0705091380c70f4290301dd424ba"}
Jul 20 13:39:06.302636 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:06.302611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-8m254" event={"ID":"1e0e3c8e-0da9-4b69-81d1-838783f53977","Type":"ContainerStarted","Data":"5e6d28f65f550a09cfbf45e867be4e0557994e8efc81ee4feb7f826ec2b4a305"}
Jul 20 13:39:06.303677 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:06.303657    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nslcs" event={"ID":"612d1abb-56c1-4cde-be96-56c80194c8df","Type":"ContainerStarted","Data":"5a9b8d9856e58fd5d8dfd0e81da57847504603c1287b729f2867202f549c14c8"}
Jul 20 13:39:07.313925 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:07.313885    2563 generic.go:356] "Generic (PLEG): container finished" podID="57041bdb-e9e0-4912-8437-8aec52acdcc6" containerID="871b77a9128424257dbc306435f3233e3a5a2986dabf215b3f37d85ebdbabd38" exitCode=0
Jul 20 13:39:07.314510 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:07.314118    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w578t" event={"ID":"57041bdb-e9e0-4912-8437-8aec52acdcc6","Type":"ContainerDied","Data":"871b77a9128424257dbc306435f3233e3a5a2986dabf215b3f37d85ebdbabd38"}
Jul 20 13:39:08.113210 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:08.113160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:08.113390 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:08.113221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:08.113390 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:08.113311    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:39:08.113390 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:08.113331    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f9678fb78-fsw84: secret "image-registry-tls" not found
Jul 20 13:39:08.113390 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:08.113336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:08.113390 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:08.113372    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:08.113390 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:08.113384    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls podName:87679bd4-e891-47df-95db-3f342730a5b4 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:12.113368256 +0000 UTC m=+43.660939621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls") pod "image-registry-6f9678fb78-fsw84" (UID: "87679bd4-e891-47df-95db-3f342730a5b4") : secret "image-registry-tls" not found
Jul 20 13:39:08.113741 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:08.113454    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls podName:a5655a72-6305-49d9-a2c1-04ebcd96660b nodeName:}" failed. No retries permitted until 2026-07-20 13:39:12.113435548 +0000 UTC m=+43.661006910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9l6hd" (UID: "a5655a72-6305-49d9-a2c1-04ebcd96660b") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:08.114179 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:08.114147    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5655a72-6305-49d9-a2c1-04ebcd96660b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:08.214303 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:08.214266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:08.214509 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:08.214477    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:39:08.214582 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:08.214555    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls podName:68723171-55ad-486f-9630-cf1ac6b48c5d nodeName:}" failed. No retries permitted until 2026-07-20 13:39:12.214534654 +0000 UTC m=+43.762106017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls") pod "dns-default-rpjrt" (UID: "68723171-55ad-486f-9630-cf1ac6b48c5d") : secret "dns-default-metrics-tls" not found
Jul 20 13:39:08.321055 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:08.320984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w578t" event={"ID":"57041bdb-e9e0-4912-8437-8aec52acdcc6","Type":"ContainerStarted","Data":"42b76d0a08e73c5e7d393835f107b33b4a2381346226a0e1ff263d595628ccb5"}
Jul 20 13:39:08.354934 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:08.354874    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w578t" podStartSLOduration=8.124937097 podStartE2EDuration="39.354855902s" totalImagesPullingTime="31.229918805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:08.35405124 +0000 UTC m=+39.901622625" watchObservedRunningTime="2026-07-20 13:39:08.354855902 +0000 UTC m=+39.902427287"
Jul 20 13:39:10.328127 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:10.327866    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-8m254" event={"ID":"1e0e3c8e-0da9-4b69-81d1-838783f53977","Type":"ContainerStarted","Data":"f22320f7cb3e1011c6aba736312eb754d16a1079e977f3712f62820ef16c7dc2"}
Jul 20 13:39:10.329465 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:10.329444    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nslcs" event={"ID":"612d1abb-56c1-4cde-be96-56c80194c8df","Type":"ContainerStarted","Data":"27b8bd6957322dda5190f0e3128d00504f70fc2bb4c8bb040cec3346cb00afde"}
Jul 20 13:39:10.343136 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:10.343019    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-8m254" podStartSLOduration=3.016306823 podStartE2EDuration="6.343004152s" totalImagesPullingTime="3.326697329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:10.342735508 +0000 UTC m=+41.890306894" watchObservedRunningTime="2026-07-20 13:39:10.343004152 +0000 UTC m=+41.890575537"
Jul 20 13:39:10.359303 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:10.359231    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nslcs" podStartSLOduration=3.029080169 podStartE2EDuration="6.359215025s" totalImagesPullingTime="3.330134856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:10.359150825 +0000 UTC m=+41.906722214" watchObservedRunningTime="2026-07-20 13:39:10.359215025 +0000 UTC m=+41.906786411"
Jul 20 13:39:12.144680 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:12.144642    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:12.144680 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:12.144683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:12.145098 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:12.144802    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:39:12.145098 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:12.144822    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f9678fb78-fsw84: secret "image-registry-tls" not found
Jul 20 13:39:12.145098 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:12.144823    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:12.145098 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:12.144885    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls podName:87679bd4-e891-47df-95db-3f342730a5b4 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:20.144870388 +0000 UTC m=+51.692441753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls") pod "image-registry-6f9678fb78-fsw84" (UID: "87679bd4-e891-47df-95db-3f342730a5b4") : secret "image-registry-tls" not found
Jul 20 13:39:12.145098 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:12.144901    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls podName:a5655a72-6305-49d9-a2c1-04ebcd96660b nodeName:}" failed. No retries permitted until 2026-07-20 13:39:20.144894979 +0000 UTC m=+51.692466342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9l6hd" (UID: "a5655a72-6305-49d9-a2c1-04ebcd96660b") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:12.245215 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:12.245179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:12.245364 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:12.245335    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:39:12.245503 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:12.245400    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls podName:68723171-55ad-486f-9630-cf1ac6b48c5d nodeName:}" failed. No retries permitted until 2026-07-20 13:39:20.245382625 +0000 UTC m=+51.792953991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls") pod "dns-default-rpjrt" (UID: "68723171-55ad-486f-9630-cf1ac6b48c5d") : secret "dns-default-metrics-tls" not found
Jul 20 13:39:20.205647 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:20.205608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:20.205647 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:20.205647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:20.209602 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:20.209572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5655a72-6305-49d9-a2c1-04ebcd96660b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9l6hd\" (UID: \"a5655a72-6305-49d9-a2c1-04ebcd96660b\") " pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:20.209602 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:20.209599    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls\") pod \"image-registry-6f9678fb78-fsw84\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") " pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:20.239238 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:20.239206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:20.279618 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:20.279588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9l6hd"
Jul 20 13:39:20.306754 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:20.306722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:20.309494 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:20.309465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68723171-55ad-486f-9630-cf1ac6b48c5d-metrics-tls\") pod \"dns-default-rpjrt\" (UID: \"68723171-55ad-486f-9630-cf1ac6b48c5d\") " pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:20.310551 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:20.310525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:20.409917 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:20.409758    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f9678fb78-fsw84"]
Jul 20 13:39:20.414448 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:20.414382    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87679bd4_e891_47df_95db_3f342730a5b4.slice/crio-b60e559fbd08299633e665ece72b5bfae8c7a214b6e2e4ab9c8b1553403280da WatchSource:0}: Error finding container b60e559fbd08299633e665ece72b5bfae8c7a214b6e2e4ab9c8b1553403280da: Status 404 returned error can't find the container with id b60e559fbd08299633e665ece72b5bfae8c7a214b6e2e4ab9c8b1553403280da
Jul 20 13:39:20.449754 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:20.449724    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9l6hd"]
Jul 20 13:39:20.453519 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:20.453491    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5655a72_6305_49d9_a2c1_04ebcd96660b.slice/crio-5ca7258228b793395d41e02c908f4cf1b557b86404d623a808f6a1cffc94cd76 WatchSource:0}: Error finding container 5ca7258228b793395d41e02c908f4cf1b557b86404d623a808f6a1cffc94cd76: Status 404 returned error can't find the container with id 5ca7258228b793395d41e02c908f4cf1b557b86404d623a808f6a1cffc94cd76
Jul 20 13:39:20.480319 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:20.480293    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rpjrt"]
Jul 20 13:39:20.494590 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:20.494553    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68723171_55ad_486f_9630_cf1ac6b48c5d.slice/crio-da16ec90d1ddb208645fab6baa33735a730258672ffcdfc359cd59e66514f929 WatchSource:0}: Error finding container da16ec90d1ddb208645fab6baa33735a730258672ffcdfc359cd59e66514f929: Status 404 returned error can't find the container with id da16ec90d1ddb208645fab6baa33735a730258672ffcdfc359cd59e66514f929
Jul 20 13:39:21.360091 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:21.360050    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9l6hd" event={"ID":"a5655a72-6305-49d9-a2c1-04ebcd96660b","Type":"ContainerStarted","Data":"5ca7258228b793395d41e02c908f4cf1b557b86404d623a808f6a1cffc94cd76"}
Jul 20 13:39:21.361594 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:21.361562    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rpjrt" event={"ID":"68723171-55ad-486f-9630-cf1ac6b48c5d","Type":"ContainerStarted","Data":"da16ec90d1ddb208645fab6baa33735a730258672ffcdfc359cd59e66514f929"}
Jul 20 13:39:21.364052 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:21.363980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84" event={"ID":"87679bd4-e891-47df-95db-3f342730a5b4","Type":"ContainerStarted","Data":"c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935"}
Jul 20 13:39:21.364052 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:21.364022    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84" event={"ID":"87679bd4-e891-47df-95db-3f342730a5b4","Type":"ContainerStarted","Data":"b60e559fbd08299633e665ece72b5bfae8c7a214b6e2e4ab9c8b1553403280da"}
Jul 20 13:39:21.364188 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:21.364136    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:21.392690 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:21.392631    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84" podStartSLOduration=58.392609609 podStartE2EDuration="58.392609609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:21.390923901 +0000 UTC m=+52.938495289" watchObservedRunningTime="2026-07-20 13:39:21.392609609 +0000 UTC m=+52.940180995"
Jul 20 13:39:26.379677 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:26.379633    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rpjrt" event={"ID":"68723171-55ad-486f-9630-cf1ac6b48c5d","Type":"ContainerStarted","Data":"16beb07c6cd1c96ad6562e4e4852694aae3e0b06f5aa6742e12ae6bd663618b0"}
Jul 20 13:39:26.380085 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:26.379744    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rpjrt" event={"ID":"68723171-55ad-486f-9630-cf1ac6b48c5d","Type":"ContainerStarted","Data":"684a9adaea077d43ec4377949b3298f245141063a58bef68b445e78d961d2105"}
Jul 20 13:39:26.380085 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:26.379774    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:26.381153 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:26.381131    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9l6hd" event={"ID":"a5655a72-6305-49d9-a2c1-04ebcd96660b","Type":"ContainerStarted","Data":"1da5658cf5fadd2f5c7f00e145867e88f78adee73796e33282b90649741a92d1"}
Jul 20 13:39:26.402150 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:26.402109    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rpjrt" podStartSLOduration=16.967957261 podStartE2EDuration="22.402094134s" totalImagesPullingTime="5.434136873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:26.402057908 +0000 UTC m=+57.949629293" watchObservedRunningTime="2026-07-20 13:39:26.402094134 +0000 UTC m=+57.949665516"
Jul 20 13:39:27.913055 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.912989    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"]
Jul 20 13:39:27.920117 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.920092    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7"]
Jul 20 13:39:27.920276 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.920220    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:27.921880 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.921861    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7b8c44bb68-lvpx2"]
Jul 20 13:39:27.922011 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.921997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7"
Jul 20 13:39:27.923147 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.923124    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 13:39:27.923272 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.923174    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 20 13:39:27.923343 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.923313    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 13:39:27.923628 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.923606    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:27.923755 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.923699    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 13:39:27.926270 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.926246    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bwqng\""
Jul 20 13:39:27.926528 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.926503    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 20 13:39:27.926528 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.926512    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 20 13:39:27.926682 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.926542    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 13:39:27.926682 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.926641    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 20 13:39:27.927122 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.927103    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 20 13:39:27.927262 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.927242    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 13:39:27.927442 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.927298    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 20 13:39:27.927712 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.927695    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n9847\""
Jul 20 13:39:27.937426 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.936469    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"]
Jul 20 13:39:27.937950 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.937932    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7"]
Jul 20 13:39:27.939683 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.939568    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b8c44bb68-lvpx2"]
Jul 20 13:39:27.960906 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.960881    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f9678fb78-fsw84"]
Jul 20 13:39:27.972380 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.972349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/175035ed-f501-43a6-8fb6-24573075d1b1-tmp\") pod \"klusterlet-addon-workmgr-54db887854-szfrv\" (UID: \"175035ed-f501-43a6-8fb6-24573075d1b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:27.972529 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.972436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk4js\" (UniqueName: \"kubernetes.io/projected/175035ed-f501-43a6-8fb6-24573075d1b1-kube-api-access-jk4js\") pod \"klusterlet-addon-workmgr-54db887854-szfrv\" (UID: \"175035ed-f501-43a6-8fb6-24573075d1b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:27.972529 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.972464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng5bm\" (UniqueName: \"kubernetes.io/projected/c6f83af7-0503-42b5-9830-9a70124e5cda-kube-api-access-ng5bm\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:27.972529 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.972503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/175035ed-f501-43a6-8fb6-24573075d1b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-54db887854-szfrv\" (UID: \"175035ed-f501-43a6-8fb6-24573075d1b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:27.972666 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.972547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6f83af7-0503-42b5-9830-9a70124e5cda-stats-auth\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:27.972666 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.972589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f83af7-0503-42b5-9830-9a70124e5cda-service-ca-bundle\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:27.972756 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.972688    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5pvz\" (UniqueName: \"kubernetes.io/projected/2cd77213-6e6b-4c3f-9876-1f98e5207147-kube-api-access-p5pvz\") pod \"managed-serviceaccount-addon-agent-6b5b85ff94-d57d7\" (UID: \"2cd77213-6e6b-4c3f-9876-1f98e5207147\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7"
Jul 20 13:39:27.972756 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.972734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f83af7-0503-42b5-9830-9a70124e5cda-metrics-certs\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:27.972825 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.972761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2cd77213-6e6b-4c3f-9876-1f98e5207147-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b5b85ff94-d57d7\" (UID: \"2cd77213-6e6b-4c3f-9876-1f98e5207147\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7"
Jul 20 13:39:27.972825 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:27.972798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6f83af7-0503-42b5-9830-9a70124e5cda-default-certificate\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:28.017637 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.017599    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"]
Jul 20 13:39:28.020798 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.020777    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"
Jul 20 13:39:28.023337 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.023310    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c97959959-fclsl"]
Jul 20 13:39:28.025060 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.025040    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 20 13:39:28.025240 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.025221    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2ppq2\""
Jul 20 13:39:28.027270 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.026323    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.027270 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.026838    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 13:39:28.027270 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.026873    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 13:39:28.027270 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.027120    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 20 13:39:28.051590 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.051558    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"]
Jul 20 13:39:28.073315 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/175035ed-f501-43a6-8fb6-24573075d1b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-54db887854-szfrv\" (UID: \"175035ed-f501-43a6-8fb6-24573075d1b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:28.073499 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6f83af7-0503-42b5-9830-9a70124e5cda-stats-auth\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:28.073499 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f83af7-0503-42b5-9830-9a70124e5cda-service-ca-bundle\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:28.073499 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz6rb\" (UniqueName: \"kubernetes.io/projected/894292f8-8752-466b-bab4-87a2d01ec6f4-kube-api-access-wz6rb\") pod \"cluster-monitoring-operator-76cf8966f8-jw9tp\" (UID: \"894292f8-8752-466b-bab4-87a2d01ec6f4\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"
Jul 20 13:39:28.073499 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5pvz\" (UniqueName: \"kubernetes.io/projected/2cd77213-6e6b-4c3f-9876-1f98e5207147-kube-api-access-p5pvz\") pod \"managed-serviceaccount-addon-agent-6b5b85ff94-d57d7\" (UID: \"2cd77213-6e6b-4c3f-9876-1f98e5207147\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7"
Jul 20 13:39:28.073499 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e736f60b-cac2-44b5-a288-8c8f58668aa8-bound-sa-token\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.073757 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e736f60b-cac2-44b5-a288-8c8f58668aa8-ca-trust-extracted\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.073757 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e736f60b-cac2-44b5-a288-8c8f58668aa8-trusted-ca\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.073757 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f83af7-0503-42b5-9830-9a70124e5cda-metrics-certs\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:28.073757 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e736f60b-cac2-44b5-a288-8c8f58668aa8-image-registry-private-configuration\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.073757 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2cd77213-6e6b-4c3f-9876-1f98e5207147-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b5b85ff94-d57d7\" (UID: \"2cd77213-6e6b-4c3f-9876-1f98e5207147\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7"
Jul 20 13:39:28.073757 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e736f60b-cac2-44b5-a288-8c8f58668aa8-registry-certificates\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.073757 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e736f60b-cac2-44b5-a288-8c8f58668aa8-registry-tls\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.073757 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6f83af7-0503-42b5-9830-9a70124e5cda-default-certificate\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:28.073757 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/894292f8-8752-466b-bab4-87a2d01ec6f4-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-jw9tp\" (UID: \"894292f8-8752-466b-bab4-87a2d01ec6f4\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"
Jul 20 13:39:28.074333 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e736f60b-cac2-44b5-a288-8c8f58668aa8-installation-pull-secrets\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.074333 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/175035ed-f501-43a6-8fb6-24573075d1b1-tmp\") pod \"klusterlet-addon-workmgr-54db887854-szfrv\" (UID: \"175035ed-f501-43a6-8fb6-24573075d1b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:28.074333 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk4js\" (UniqueName: \"kubernetes.io/projected/175035ed-f501-43a6-8fb6-24573075d1b1-kube-api-access-jk4js\") pod \"klusterlet-addon-workmgr-54db887854-szfrv\" (UID: \"175035ed-f501-43a6-8fb6-24573075d1b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:28.074333 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/894292f8-8752-466b-bab4-87a2d01ec6f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jw9tp\" (UID: \"894292f8-8752-466b-bab4-87a2d01ec6f4\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"
Jul 20 13:39:28.074333 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng5bm\" (UniqueName: \"kubernetes.io/projected/c6f83af7-0503-42b5-9830-9a70124e5cda-kube-api-access-ng5bm\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:28.074333 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.073909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmmf7\" (UniqueName: \"kubernetes.io/projected/e736f60b-cac2-44b5-a288-8c8f58668aa8-kube-api-access-jmmf7\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.075316 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.075253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/175035ed-f501-43a6-8fb6-24573075d1b1-tmp\") pod \"klusterlet-addon-workmgr-54db887854-szfrv\" (UID: \"175035ed-f501-43a6-8fb6-24573075d1b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:28.075316 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.075285    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f83af7-0503-42b5-9830-9a70124e5cda-service-ca-bundle\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:28.077919 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.077324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2cd77213-6e6b-4c3f-9876-1f98e5207147-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b5b85ff94-d57d7\" (UID: \"2cd77213-6e6b-4c3f-9876-1f98e5207147\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7"
Jul 20 13:39:28.077919 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.077876    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/175035ed-f501-43a6-8fb6-24573075d1b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-54db887854-szfrv\" (UID: \"175035ed-f501-43a6-8fb6-24573075d1b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:28.078340 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.078319    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6f83af7-0503-42b5-9830-9a70124e5cda-default-certificate\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:28.079245 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.079221    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f83af7-0503-42b5-9830-9a70124e5cda-metrics-certs\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:28.079358 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.079271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6f83af7-0503-42b5-9830-9a70124e5cda-stats-auth\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:28.087934 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.087907    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c97959959-fclsl"]
Jul 20 13:39:28.097936 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.097913    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng5bm\" (UniqueName: \"kubernetes.io/projected/c6f83af7-0503-42b5-9830-9a70124e5cda-kube-api-access-ng5bm\") pod \"router-default-7b8c44bb68-lvpx2\" (UID: \"c6f83af7-0503-42b5-9830-9a70124e5cda\") " pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:28.098048 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.097938    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5pvz\" (UniqueName: \"kubernetes.io/projected/2cd77213-6e6b-4c3f-9876-1f98e5207147-kube-api-access-p5pvz\") pod \"managed-serviceaccount-addon-agent-6b5b85ff94-d57d7\" (UID: \"2cd77213-6e6b-4c3f-9876-1f98e5207147\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7"
Jul 20 13:39:28.098048 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.098024    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk4js\" (UniqueName: \"kubernetes.io/projected/175035ed-f501-43a6-8fb6-24573075d1b1-kube-api-access-jk4js\") pod \"klusterlet-addon-workmgr-54db887854-szfrv\" (UID: \"175035ed-f501-43a6-8fb6-24573075d1b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:28.175121 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.175038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz6rb\" (UniqueName: \"kubernetes.io/projected/894292f8-8752-466b-bab4-87a2d01ec6f4-kube-api-access-wz6rb\") pod \"cluster-monitoring-operator-76cf8966f8-jw9tp\" (UID: \"894292f8-8752-466b-bab4-87a2d01ec6f4\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"
Jul 20 13:39:28.175121 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.175091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e736f60b-cac2-44b5-a288-8c8f58668aa8-bound-sa-token\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.175347 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.175207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e736f60b-cac2-44b5-a288-8c8f58668aa8-ca-trust-extracted\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.175347 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.175255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e736f60b-cac2-44b5-a288-8c8f58668aa8-trusted-ca\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.175347 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.175296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e736f60b-cac2-44b5-a288-8c8f58668aa8-image-registry-private-configuration\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.175347 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.175327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e736f60b-cac2-44b5-a288-8c8f58668aa8-registry-certificates\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.175567 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.175359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e736f60b-cac2-44b5-a288-8c8f58668aa8-registry-tls\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.175567 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.175390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/894292f8-8752-466b-bab4-87a2d01ec6f4-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-jw9tp\" (UID: \"894292f8-8752-466b-bab4-87a2d01ec6f4\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"
Jul 20 13:39:28.175567 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.175439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e736f60b-cac2-44b5-a288-8c8f58668aa8-installation-pull-secrets\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.175567 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.175503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/894292f8-8752-466b-bab4-87a2d01ec6f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jw9tp\" (UID: \"894292f8-8752-466b-bab4-87a2d01ec6f4\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"
Jul 20 13:39:28.175567 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.175532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmmf7\" (UniqueName: \"kubernetes.io/projected/e736f60b-cac2-44b5-a288-8c8f58668aa8-kube-api-access-jmmf7\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.175814 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.175652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e736f60b-cac2-44b5-a288-8c8f58668aa8-ca-trust-extracted\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.176441 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.176380    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e736f60b-cac2-44b5-a288-8c8f58668aa8-registry-certificates\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.176574 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.176507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e736f60b-cac2-44b5-a288-8c8f58668aa8-trusted-ca\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.176673 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.176650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/894292f8-8752-466b-bab4-87a2d01ec6f4-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-jw9tp\" (UID: \"894292f8-8752-466b-bab4-87a2d01ec6f4\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"
Jul 20 13:39:28.178261 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.178235    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e736f60b-cac2-44b5-a288-8c8f58668aa8-image-registry-private-configuration\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.178485 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.178458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e736f60b-cac2-44b5-a288-8c8f58668aa8-registry-tls\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.178664 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.178461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e736f60b-cac2-44b5-a288-8c8f58668aa8-installation-pull-secrets\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.179086 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.179069    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/894292f8-8752-466b-bab4-87a2d01ec6f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jw9tp\" (UID: \"894292f8-8752-466b-bab4-87a2d01ec6f4\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"
Jul 20 13:39:28.188047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.188024    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmmf7\" (UniqueName: \"kubernetes.io/projected/e736f60b-cac2-44b5-a288-8c8f58668aa8-kube-api-access-jmmf7\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.190758 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.190727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e736f60b-cac2-44b5-a288-8c8f58668aa8-bound-sa-token\") pod \"image-registry-7c97959959-fclsl\" (UID: \"e736f60b-cac2-44b5-a288-8c8f58668aa8\") " pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.199756 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.199726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz6rb\" (UniqueName: \"kubernetes.io/projected/894292f8-8752-466b-bab4-87a2d01ec6f4-kube-api-access-wz6rb\") pod \"cluster-monitoring-operator-76cf8966f8-jw9tp\" (UID: \"894292f8-8752-466b-bab4-87a2d01ec6f4\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"
Jul 20 13:39:28.214046 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.214004    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-z7cgr"]
Jul 20 13:39:28.219755 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.219716    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-z7cgr"
Jul 20 13:39:28.222629 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.222607    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nxl9d\""
Jul 20 13:39:28.223832 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.223807    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 13:39:28.223933 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.223809    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 13:39:28.233039 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.233017    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:28.238254 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.238228    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-z7cgr"]
Jul 20 13:39:28.246967 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.246941    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7"
Jul 20 13:39:28.253576 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.253551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:28.276517 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.276480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx892\" (UniqueName: \"kubernetes.io/projected/07f18032-c55c-4731-9383-03487b0b0193-kube-api-access-bx892\") pod \"downloads-5bc67dcd46-z7cgr\" (UID: \"07f18032-c55c-4731-9383-03487b0b0193\") " pod="openshift-console/downloads-5bc67dcd46-z7cgr"
Jul 20 13:39:28.334254 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.334221    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"
Jul 20 13:39:28.340637 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.340614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:28.377076 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.377048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx892\" (UniqueName: \"kubernetes.io/projected/07f18032-c55c-4731-9383-03487b0b0193-kube-api-access-bx892\") pod \"downloads-5bc67dcd46-z7cgr\" (UID: \"07f18032-c55c-4731-9383-03487b0b0193\") " pod="openshift-console/downloads-5bc67dcd46-z7cgr"
Jul 20 13:39:28.393470 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.393445    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx892\" (UniqueName: \"kubernetes.io/projected/07f18032-c55c-4731-9383-03487b0b0193-kube-api-access-bx892\") pod \"downloads-5bc67dcd46-z7cgr\" (UID: \"07f18032-c55c-4731-9383-03487b0b0193\") " pod="openshift-console/downloads-5bc67dcd46-z7cgr"
Jul 20 13:39:28.530516 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:28.530424    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-z7cgr"
Jul 20 13:39:29.641882 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:29.641852    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7"]
Jul 20 13:39:29.653486 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:29.653344    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cd77213_6e6b_4c3f_9876_1f98e5207147.slice/crio-af8f6005c713b3f6421ee6dc812890b25ab54d0c605570b9b283d198ae5209f9 WatchSource:0}: Error finding container af8f6005c713b3f6421ee6dc812890b25ab54d0c605570b9b283d198ae5209f9: Status 404 returned error can't find the container with id af8f6005c713b3f6421ee6dc812890b25ab54d0c605570b9b283d198ae5209f9
Jul 20 13:39:29.855338 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:29.855286    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-z7cgr"]
Jul 20 13:39:29.856627 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:29.856600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"]
Jul 20 13:39:29.857646 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:29.857612    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07f18032_c55c_4731_9383_03487b0b0193.slice/crio-d74639c668a927934d5a748f380570dc10d06d93c6e057526070f7146de3c366 WatchSource:0}: Error finding container d74639c668a927934d5a748f380570dc10d06d93c6e057526070f7146de3c366: Status 404 returned error can't find the container with id d74639c668a927934d5a748f380570dc10d06d93c6e057526070f7146de3c366
Jul 20 13:39:29.862065 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:29.859064    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175035ed_f501_43a6_8fb6_24573075d1b1.slice/crio-e28d9461427114b0023662b5f23ec4c89ae3365f4aeafefc826bc375bb666574 WatchSource:0}: Error finding container e28d9461427114b0023662b5f23ec4c89ae3365f4aeafefc826bc375bb666574: Status 404 returned error can't find the container with id e28d9461427114b0023662b5f23ec4c89ae3365f4aeafefc826bc375bb666574
Jul 20 13:39:29.862065 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:29.861309    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp"]
Jul 20 13:39:29.862521 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:29.862458    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b8c44bb68-lvpx2"]
Jul 20 13:39:29.864181 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:29.863962    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c97959959-fclsl"]
Jul 20 13:39:29.865465 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:29.865382    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894292f8_8752_466b_bab4_87a2d01ec6f4.slice/crio-ed01513cea354fb1f4287b05e1b1457edf66c608830e39a3ce1c8dc22c2d32d1 WatchSource:0}: Error finding container ed01513cea354fb1f4287b05e1b1457edf66c608830e39a3ce1c8dc22c2d32d1: Status 404 returned error can't find the container with id ed01513cea354fb1f4287b05e1b1457edf66c608830e39a3ce1c8dc22c2d32d1
Jul 20 13:39:29.866768 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:29.866744    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f83af7_0503_42b5_9830_9a70124e5cda.slice/crio-15c6dd06485949e1057a0b5d267e94db2bc874d31437c44b90deee74bce2bd74 WatchSource:0}: Error finding container 15c6dd06485949e1057a0b5d267e94db2bc874d31437c44b90deee74bce2bd74: Status 404 returned error can't find the container with id 15c6dd06485949e1057a0b5d267e94db2bc874d31437c44b90deee74bce2bd74
Jul 20 13:39:29.868132 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:29.868109    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode736f60b_cac2_44b5_a288_8c8f58668aa8.slice/crio-0a698c498bbc54d5cf21a8022ce91eee416bbe1a79971ecf667e0599a8aa4b6f WatchSource:0}: Error finding container 0a698c498bbc54d5cf21a8022ce91eee416bbe1a79971ecf667e0599a8aa4b6f: Status 404 returned error can't find the container with id 0a698c498bbc54d5cf21a8022ce91eee416bbe1a79971ecf667e0599a8aa4b6f
Jul 20 13:39:30.298989 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.298896    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk7fg"
Jul 20 13:39:30.401794 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.401742    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9l6hd" event={"ID":"a5655a72-6305-49d9-a2c1-04ebcd96660b","Type":"ContainerStarted","Data":"5ab585d2a9e86c2bc949f6361aa5c5fabc4a640ff2893001cdc3edd7f545734c"}
Jul 20 13:39:30.407225 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.406631    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c97959959-fclsl" event={"ID":"e736f60b-cac2-44b5-a288-8c8f58668aa8","Type":"ContainerStarted","Data":"84b157114bc679623e20df961bc61f84f78c037730e6822fbc4929387d1ed65d"}
Jul 20 13:39:30.407225 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.406691    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c97959959-fclsl" event={"ID":"e736f60b-cac2-44b5-a288-8c8f58668aa8","Type":"ContainerStarted","Data":"0a698c498bbc54d5cf21a8022ce91eee416bbe1a79971ecf667e0599a8aa4b6f"}
Jul 20 13:39:30.407225 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.407091    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:30.409069 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.409036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-z7cgr" event={"ID":"07f18032-c55c-4731-9383-03487b0b0193","Type":"ContainerStarted","Data":"d74639c668a927934d5a748f380570dc10d06d93c6e057526070f7146de3c366"}
Jul 20 13:39:30.411889 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.411794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b8c44bb68-lvpx2" event={"ID":"c6f83af7-0503-42b5-9830-9a70124e5cda","Type":"ContainerStarted","Data":"8571ac10cc076e9cf2c6f809ebc45da8fed626d8168beaa4ff7876324d702abd"}
Jul 20 13:39:30.411889 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.411841    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b8c44bb68-lvpx2" event={"ID":"c6f83af7-0503-42b5-9830-9a70124e5cda","Type":"ContainerStarted","Data":"15c6dd06485949e1057a0b5d267e94db2bc874d31437c44b90deee74bce2bd74"}
Jul 20 13:39:30.414619 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.414594    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp" event={"ID":"894292f8-8752-466b-bab4-87a2d01ec6f4","Type":"ContainerStarted","Data":"ed01513cea354fb1f4287b05e1b1457edf66c608830e39a3ce1c8dc22c2d32d1"}
Jul 20 13:39:30.416148 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.416128    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv" event={"ID":"175035ed-f501-43a6-8fb6-24573075d1b1","Type":"ContainerStarted","Data":"e28d9461427114b0023662b5f23ec4c89ae3365f4aeafefc826bc375bb666574"}
Jul 20 13:39:30.419928 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.419900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7" event={"ID":"2cd77213-6e6b-4c3f-9876-1f98e5207147","Type":"ContainerStarted","Data":"af8f6005c713b3f6421ee6dc812890b25ab54d0c605570b9b283d198ae5209f9"}
Jul 20 13:39:30.434455 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.434381    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c97959959-fclsl" podStartSLOduration=3.434360796 podStartE2EDuration="3.434360796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:30.433735991 +0000 UTC m=+61.981307370" watchObservedRunningTime="2026-07-20 13:39:30.434360796 +0000 UTC m=+61.981932162"
Jul 20 13:39:30.478555 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:30.478471    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7b8c44bb68-lvpx2" podStartSLOduration=3.478448809 podStartE2EDuration="3.478448809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:30.476048221 +0000 UTC m=+62.023619607" watchObservedRunningTime="2026-07-20 13:39:30.478448809 +0000 UTC m=+62.026020174"
Jul 20 13:39:31.254463 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:31.254426    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:31.258592 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:31.258352    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:31.428006 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:31.427910    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:31.429828 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:31.429597    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7b8c44bb68-lvpx2"
Jul 20 13:39:34.744675 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.744631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:39:34.745145 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.744747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:39:34.747506 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.747474    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 13:39:34.748796 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.748569    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 13:39:34.758642 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.758613    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4862d09-2821-4eef-84ef-b9c93c75030b-metrics-certs\") pod \"network-metrics-daemon-q4n2d\" (UID: \"f4862d09-2821-4eef-84ef-b9c93c75030b\") " pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:39:34.759187 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.759161    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12aecb57-1243-492c-9f94-cadbcafa4b5f-original-pull-secret\") pod \"global-pull-secret-syncer-82vx5\" (UID: \"12aecb57-1243-492c-9f94-cadbcafa4b5f\") " pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:39:34.845482 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.845432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpw8d\" (UniqueName: \"kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d\") pod \"network-check-target-vq2hf\" (UID: \"4b71405d-76e4-468b-bfcc-51b2e5550ca2\") " pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:39:34.848178 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.848146    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 13:39:34.858851 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.858824    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 13:39:34.870165 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.870100    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpw8d\" (UniqueName: \"kubernetes.io/projected/4b71405d-76e4-468b-bfcc-51b2e5550ca2-kube-api-access-gpw8d\") pod \"network-check-target-vq2hf\" (UID: \"4b71405d-76e4-468b-bfcc-51b2e5550ca2\") " pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:39:34.953265 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.953230    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82vx5"
Jul 20 13:39:34.962727 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.962690    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpj58\""
Jul 20 13:39:34.972115 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.967581    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rd77k\""
Jul 20 13:39:34.972115 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.969603    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:39:34.975324 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:34.975291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4n2d"
Jul 20 13:39:36.388565 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:36.388533    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rpjrt"
Jul 20 13:39:37.968301 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:37.968257    2563 patch_prober.go:28] interesting pod/image-registry-6f9678fb78-fsw84 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 13:39:37.968791 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:37.968337    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84" podUID="87679bd4-e891-47df-95db-3f342730a5b4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 13:39:38.245977 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.245591    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vq2hf"]
Jul 20 13:39:38.254665 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:38.254630    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b71405d_76e4_468b_bfcc_51b2e5550ca2.slice/crio-37c77bbbcc3ec9ea350e18334ba79988e355aa6c4e941215770f0afccd6d0f5f WatchSource:0}: Error finding container 37c77bbbcc3ec9ea350e18334ba79988e355aa6c4e941215770f0afccd6d0f5f: Status 404 returned error can't find the container with id 37c77bbbcc3ec9ea350e18334ba79988e355aa6c4e941215770f0afccd6d0f5f
Jul 20 13:39:38.282738 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.282345    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-82vx5"]
Jul 20 13:39:38.303964 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.303933    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q4n2d"]
Jul 20 13:39:38.307766 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:38.307721    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4862d09_2821_4eef_84ef_b9c93c75030b.slice/crio-71f9661809fcf789b003c07de3c9f422476ac546b2eb22fff5b6ab371b499752 WatchSource:0}: Error finding container 71f9661809fcf789b003c07de3c9f422476ac546b2eb22fff5b6ab371b499752: Status 404 returned error can't find the container with id 71f9661809fcf789b003c07de3c9f422476ac546b2eb22fff5b6ab371b499752
Jul 20 13:39:38.463812 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.463766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vq2hf" event={"ID":"4b71405d-76e4-468b-bfcc-51b2e5550ca2","Type":"ContainerStarted","Data":"37c77bbbcc3ec9ea350e18334ba79988e355aa6c4e941215770f0afccd6d0f5f"}
Jul 20 13:39:38.465424 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.465374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7" event={"ID":"2cd77213-6e6b-4c3f-9876-1f98e5207147","Type":"ContainerStarted","Data":"0f4ab9b162eb6918ea2fc22d6146e93986c48a1ac31c8aca099dd2d4574fb906"}
Jul 20 13:39:38.466922 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.466877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-82vx5" event={"ID":"12aecb57-1243-492c-9f94-cadbcafa4b5f","Type":"ContainerStarted","Data":"2d797c63171b54ba85010f035774369b668b2c6a48ea6dcf9973f5396c1afd72"}
Jul 20 13:39:38.468282 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.468252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4n2d" event={"ID":"f4862d09-2821-4eef-84ef-b9c93c75030b","Type":"ContainerStarted","Data":"71f9661809fcf789b003c07de3c9f422476ac546b2eb22fff5b6ab371b499752"}
Jul 20 13:39:38.471444 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.471381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9l6hd" event={"ID":"a5655a72-6305-49d9-a2c1-04ebcd96660b","Type":"ContainerStarted","Data":"8fddf1070ba59f9adb562deba84be621ff9dc73a64b4e0afbd51229160916d54"}
Jul 20 13:39:38.473356 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.473305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp" event={"ID":"894292f8-8752-466b-bab4-87a2d01ec6f4","Type":"ContainerStarted","Data":"745e08c9bff171507f749c5b41675aad62f1f5770f11513f5fb44a6e9202f491"}
Jul 20 13:39:38.475325 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.475295    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv" event={"ID":"175035ed-f501-43a6-8fb6-24573075d1b1","Type":"ContainerStarted","Data":"394faa03ad2faf20c76374c8de4c1ad9e531ab587da21b72cd8c3d8207167787"}
Jul 20 13:39:38.475440 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.475389    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:38.477357 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.477340    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv"
Jul 20 13:39:38.482202 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.482156    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5b85ff94-d57d7" podStartSLOduration=3.102173574 podStartE2EDuration="11.482139526s" totalImagesPullingTime="8.379965952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:38.482073947 +0000 UTC m=+70.029645332" watchObservedRunningTime="2026-07-20 13:39:38.482139526 +0000 UTC m=+70.029710912"
Jul 20 13:39:38.540027 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.539933    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9l6hd" podStartSLOduration=17.156217001999998 podStartE2EDuration="34.539911996s" totalImagesPullingTime="17.383694994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:39:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:38.509659047 +0000 UTC m=+70.057230445" watchObservedRunningTime="2026-07-20 13:39:38.539911996 +0000 UTC m=+70.087483383"
Jul 20 13:39:38.540327 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.540302    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db887854-szfrv" podStartSLOduration=3.344272512 podStartE2EDuration="11.54029397s" totalImagesPullingTime="8.196021458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:38.539656204 +0000 UTC m=+70.087227593" watchObservedRunningTime="2026-07-20 13:39:38.54029397 +0000 UTC m=+70.087865355"
Jul 20 13:39:38.561566 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:38.561493    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jw9tp" podStartSLOduration=3.388671259 podStartE2EDuration="11.561471687s" totalImagesPullingTime="8.172800428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:38.560106604 +0000 UTC m=+70.107678068" watchObservedRunningTime="2026-07-20 13:39:38.561471687 +0000 UTC m=+70.109043074"
Jul 20 13:39:41.497683 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:41.496990    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4n2d" event={"ID":"f4862d09-2821-4eef-84ef-b9c93c75030b","Type":"ContainerStarted","Data":"bc87463241a8a75268ca1f885c10cdadb9f7985406b60428fd73f1e01767f42c"}
Jul 20 13:39:41.497683 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:41.497061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4n2d" event={"ID":"f4862d09-2821-4eef-84ef-b9c93c75030b","Type":"ContainerStarted","Data":"81a0db3899cd3134529d617ab883c77bba2ac4984c2df30555ab62371e632dbb"}
Jul 20 13:39:47.965916 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:47.965838    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:47.999626 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:47.999567    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q4n2d" podStartSLOduration=76.957613255 podStartE2EDuration="1m18.999547101s" totalImagesPullingTime="2.041933846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:41.518456804 +0000 UTC m=+73.066028190" watchObservedRunningTime="2026-07-20 13:39:47.999547101 +0000 UTC m=+79.547118491"
Jul 20 13:39:49.471591 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.471552    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zz728"]
Jul 20 13:39:49.518627 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.518593    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.522435 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.522229    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q6f2h\""
Jul 20 13:39:49.522435 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.522362    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 13:39:49.523422 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.523076    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 13:39:49.523422 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.523186    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 13:39:49.523422 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.523273    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 13:39:49.676171 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.676135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.676347 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.676187    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-textfile\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.676347 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.676242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf60d30-1040-43bc-8ee7-358ae42ae640-metrics-client-ca\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.676347 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.676332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jgrt\" (UniqueName: \"kubernetes.io/projected/acf60d30-1040-43bc-8ee7-358ae42ae640-kube-api-access-2jgrt\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.676536 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.676373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-tls\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.676536 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.676425    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-accelerators-collector-config\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.676536 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.676458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acf60d30-1040-43bc-8ee7-358ae42ae640-sys\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.676536 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.676480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-wtmp\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.676726 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.676604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acf60d30-1040-43bc-8ee7-358ae42ae640-root\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.777433 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.777316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acf60d30-1040-43bc-8ee7-358ae42ae640-root\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.777433 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.777382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.777725 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.777439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-textfile\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.777725 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.777465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf60d30-1040-43bc-8ee7-358ae42ae640-metrics-client-ca\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.777725 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.777492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jgrt\" (UniqueName: \"kubernetes.io/projected/acf60d30-1040-43bc-8ee7-358ae42ae640-kube-api-access-2jgrt\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.777725 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.777524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-tls\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.777725 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.777547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-accelerators-collector-config\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.777725 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.777576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acf60d30-1040-43bc-8ee7-358ae42ae640-sys\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.777725 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.777607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-wtmp\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.778160 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.777824    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-wtmp\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.778160 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.777876    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acf60d30-1040-43bc-8ee7-358ae42ae640-root\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.779018 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.778641    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-textfile\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.779018 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.778716    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acf60d30-1040-43bc-8ee7-358ae42ae640-sys\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.779018 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.778951    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf60d30-1040-43bc-8ee7-358ae42ae640-metrics-client-ca\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.779221 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.779044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-accelerators-collector-config\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.780878 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.780850    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.781308 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.781287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acf60d30-1040-43bc-8ee7-358ae42ae640-node-exporter-tls\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.788186 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.788160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jgrt\" (UniqueName: \"kubernetes.io/projected/acf60d30-1040-43bc-8ee7-358ae42ae640-kube-api-access-2jgrt\") pod \"node-exporter-zz728\" (UID: \"acf60d30-1040-43bc-8ee7-358ae42ae640\") " pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:49.830377 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:49.830249    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zz728"
Jul 20 13:39:51.312600 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:39:51.312562    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf60d30_1040_43bc_8ee7_358ae42ae640.slice/crio-d30dd0820f63f3f5bc682471faad93d79a31c9c122322e05240d1787dd76bd71 WatchSource:0}: Error finding container d30dd0820f63f3f5bc682471faad93d79a31c9c122322e05240d1787dd76bd71: Status 404 returned error can't find the container with id d30dd0820f63f3f5bc682471faad93d79a31c9c122322e05240d1787dd76bd71
Jul 20 13:39:51.433036 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:51.433008    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c97959959-fclsl"
Jul 20 13:39:51.536566 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:51.536087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vq2hf" event={"ID":"4b71405d-76e4-468b-bfcc-51b2e5550ca2","Type":"ContainerStarted","Data":"3b87ba6de980441f91a0da5f62eacce546dc133031848364ab881ad3e0d91cd0"}
Jul 20 13:39:51.536566 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:51.536183    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:39:51.537968 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:51.537939    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-82vx5" event={"ID":"12aecb57-1243-492c-9f94-cadbcafa4b5f","Type":"ContainerStarted","Data":"42f4eacd648f3f94810bf1495e2c61b0cfb38f3e37c0594210be5c8592c1d5b3"}
Jul 20 13:39:51.539290 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:51.539265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zz728" event={"ID":"acf60d30-1040-43bc-8ee7-358ae42ae640","Type":"ContainerStarted","Data":"d30dd0820f63f3f5bc682471faad93d79a31c9c122322e05240d1787dd76bd71"}
Jul 20 13:39:51.540804 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:51.540777    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-z7cgr" event={"ID":"07f18032-c55c-4731-9383-03487b0b0193","Type":"ContainerStarted","Data":"4d6d65e236c49043d4edf47920e931303d111aee6b04518c0fd4eba3f77514bf"}
Jul 20 13:39:51.541015 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:51.540994    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-z7cgr"
Jul 20 13:39:51.542490 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:51.542468    2563 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-z7cgr container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.16:8080/\": dial tcp 10.133.0.16:8080: connect: connection refused" start-of-body=
Jul 20 13:39:51.542605 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:51.542509    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-z7cgr" podUID="07f18032-c55c-4731-9383-03487b0b0193" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.16:8080/\": dial tcp 10.133.0.16:8080: connect: connection refused"
Jul 20 13:39:51.576368 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:51.576307    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vq2hf" podStartSLOduration=69.524800712 podStartE2EDuration="1m22.576290343s" totalImagesPullingTime="13.051489631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:51.575239612 +0000 UTC m=+83.122810997" watchObservedRunningTime="2026-07-20 13:39:51.576290343 +0000 UTC m=+83.123861772"
Jul 20 13:39:51.610268 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:51.610171    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-z7cgr" podStartSLOduration=2.11534146 podStartE2EDuration="23.610148553s" totalImagesPullingTime="21.494807093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:51.609103782 +0000 UTC m=+83.156675167" watchObservedRunningTime="2026-07-20 13:39:51.610148553 +0000 UTC m=+83.157719937"
Jul 20 13:39:51.646783 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:51.646707    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-82vx5" podStartSLOduration=69.628487 podStartE2EDuration="1m22.646691812s" totalImagesPullingTime="13.018204812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:51.645574957 +0000 UTC m=+83.193146342" watchObservedRunningTime="2026-07-20 13:39:51.646691812 +0000 UTC m=+83.194263201"
Jul 20 13:39:52.555197 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:52.554976    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-z7cgr"
Jul 20 13:39:52.984469 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:52.984391    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84" podUID="87679bd4-e891-47df-95db-3f342730a5b4" containerName="registry" containerID="cri-o://c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935" gracePeriod=30
Jul 20 13:39:53.353686 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.353660    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:53.515575 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.515491    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87679bd4-e891-47df-95db-3f342730a5b4-trusted-ca\") pod \"87679bd4-e891-47df-95db-3f342730a5b4\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") "
Jul 20 13:39:53.515575 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.515544    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls\") pod \"87679bd4-e891-47df-95db-3f342730a5b4\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") "
Jul 20 13:39:53.515806 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.515576    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87679bd4-e891-47df-95db-3f342730a5b4-installation-pull-secrets\") pod \"87679bd4-e891-47df-95db-3f342730a5b4\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") "
Jul 20 13:39:53.515806 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.515611    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87679bd4-e891-47df-95db-3f342730a5b4-registry-certificates\") pod \"87679bd4-e891-47df-95db-3f342730a5b4\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") "
Jul 20 13:39:53.515806 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.515644    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-bound-sa-token\") pod \"87679bd4-e891-47df-95db-3f342730a5b4\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") "
Jul 20 13:39:53.515806 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.515686    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5h97\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-kube-api-access-c5h97\") pod \"87679bd4-e891-47df-95db-3f342730a5b4\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") "
Jul 20 13:39:53.515806 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.515723    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87679bd4-e891-47df-95db-3f342730a5b4-image-registry-private-configuration\") pod \"87679bd4-e891-47df-95db-3f342730a5b4\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") "
Jul 20 13:39:53.515806 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.515772    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87679bd4-e891-47df-95db-3f342730a5b4-ca-trust-extracted\") pod \"87679bd4-e891-47df-95db-3f342730a5b4\" (UID: \"87679bd4-e891-47df-95db-3f342730a5b4\") "
Jul 20 13:39:53.516100 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.515913    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87679bd4-e891-47df-95db-3f342730a5b4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "87679bd4-e891-47df-95db-3f342730a5b4" (UID: "87679bd4-e891-47df-95db-3f342730a5b4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:39:53.516100 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.516053    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87679bd4-e891-47df-95db-3f342730a5b4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "87679bd4-e891-47df-95db-3f342730a5b4" (UID: "87679bd4-e891-47df-95db-3f342730a5b4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:39:53.518843 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.518807    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "87679bd4-e891-47df-95db-3f342730a5b4" (UID: "87679bd4-e891-47df-95db-3f342730a5b4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:39:53.518979 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.518880    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87679bd4-e891-47df-95db-3f342730a5b4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "87679bd4-e891-47df-95db-3f342730a5b4" (UID: "87679bd4-e891-47df-95db-3f342730a5b4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:39:53.519139 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.519111    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "87679bd4-e891-47df-95db-3f342730a5b4" (UID: "87679bd4-e891-47df-95db-3f342730a5b4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:39:53.519276 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.519251    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-kube-api-access-c5h97" (OuterVolumeSpecName: "kube-api-access-c5h97") pod "87679bd4-e891-47df-95db-3f342730a5b4" (UID: "87679bd4-e891-47df-95db-3f342730a5b4"). InnerVolumeSpecName "kube-api-access-c5h97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:39:53.519484 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.519460    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87679bd4-e891-47df-95db-3f342730a5b4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "87679bd4-e891-47df-95db-3f342730a5b4" (UID: "87679bd4-e891-47df-95db-3f342730a5b4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:39:53.526365 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.526338    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87679bd4-e891-47df-95db-3f342730a5b4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "87679bd4-e891-47df-95db-3f342730a5b4" (UID: "87679bd4-e891-47df-95db-3f342730a5b4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:39:53.554090 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.554050    2563 generic.go:356] "Generic (PLEG): container finished" podID="acf60d30-1040-43bc-8ee7-358ae42ae640" containerID="50bb895af0d01e02f764fd083c7d8f0ef595c2dc639384f6bcc5954f0213403f" exitCode=0
Jul 20 13:39:53.554319 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.554149    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zz728" event={"ID":"acf60d30-1040-43bc-8ee7-358ae42ae640","Type":"ContainerDied","Data":"50bb895af0d01e02f764fd083c7d8f0ef595c2dc639384f6bcc5954f0213403f"}
Jul 20 13:39:53.557103 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.555747    2563 generic.go:356] "Generic (PLEG): container finished" podID="87679bd4-e891-47df-95db-3f342730a5b4" containerID="c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935" exitCode=0
Jul 20 13:39:53.557103 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.555782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84" event={"ID":"87679bd4-e891-47df-95db-3f342730a5b4","Type":"ContainerDied","Data":"c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935"}
Jul 20 13:39:53.557103 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.555808    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84"
Jul 20 13:39:53.557103 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.555839    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f9678fb78-fsw84" event={"ID":"87679bd4-e891-47df-95db-3f342730a5b4","Type":"ContainerDied","Data":"b60e559fbd08299633e665ece72b5bfae8c7a214b6e2e4ab9c8b1553403280da"}
Jul 20 13:39:53.557103 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.555873    2563 scope.go:117] "RemoveContainer" containerID="c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935"
Jul 20 13:39:53.566336 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.566315    2563 scope.go:117] "RemoveContainer" containerID="c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935"
Jul 20 13:39:53.566666 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:39:53.566643    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935\": container with ID starting with c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935 not found: ID does not exist" containerID="c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935"
Jul 20 13:39:53.566751 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.566671    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935"} err="failed to get container status \"c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935\": rpc error: code = NotFound desc = could not find container \"c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935\": container with ID starting with c722a5342b265a0575b5090dc6ad2358bb82f8998013a6400cf1bd22cda41935 not found: ID does not exist"
Jul 20 13:39:53.616913 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.616798    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87679bd4-e891-47df-95db-3f342730a5b4-image-registry-private-configuration\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:39:53.616913 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.616827    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87679bd4-e891-47df-95db-3f342730a5b4-ca-trust-extracted\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:39:53.616913 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.616843    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87679bd4-e891-47df-95db-3f342730a5b4-trusted-ca\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:39:53.616913 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.616859    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-registry-tls\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:39:53.616913 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.616873    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87679bd4-e891-47df-95db-3f342730a5b4-installation-pull-secrets\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:39:53.616913 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.616887    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87679bd4-e891-47df-95db-3f342730a5b4-registry-certificates\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:39:53.616913 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.616900    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-bound-sa-token\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:39:53.616913 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.616913    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5h97\" (UniqueName: \"kubernetes.io/projected/87679bd4-e891-47df-95db-3f342730a5b4-kube-api-access-c5h97\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:39:53.617339 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.617303    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f9678fb78-fsw84"]
Jul 20 13:39:53.627285 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:53.627257    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f9678fb78-fsw84"]
Jul 20 13:39:54.564288 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:54.564191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zz728" event={"ID":"acf60d30-1040-43bc-8ee7-358ae42ae640","Type":"ContainerStarted","Data":"f08a524249e27eabb1a6c38d11fc3eb4a97689621709755f787ee9cfee2b1feb"}
Jul 20 13:39:54.564288 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:54.564267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zz728" event={"ID":"acf60d30-1040-43bc-8ee7-358ae42ae640","Type":"ContainerStarted","Data":"73ec8ac693d43417cb9b0b57ca228182f090161351631af65f631a1834c158bb"}
Jul 20 13:39:54.945727 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:39:54.945692    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87679bd4-e891-47df-95db-3f342730a5b4" path="/var/lib/kubelet/pods/87679bd4-e891-47df-95db-3f342730a5b4/volumes"
Jul 20 13:40:22.551606 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:40:22.551574    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vq2hf"
Jul 20 13:40:22.586465 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:40:22.586390    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zz728" podStartSLOduration=31.601102758 podStartE2EDuration="33.586374564s" totalImagesPullingTime="1.870726493s" totalInitContainerRuntime="114.545313ms" isStatefulPod=true podCreationTimestamp="2026-07-20 13:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:54.602771037 +0000 UTC m=+86.150342424" watchObservedRunningTime="2026-07-20 13:40:22.586374564 +0000 UTC m=+114.133945949"
Jul 20 13:40:23.720086 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:40:23.720054    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b8c44bb68-lvpx2_c6f83af7-0503-42b5-9830-9a70124e5cda/router/0.log"
Jul 20 13:40:23.745634 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:40:23.745613    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nslcs_612d1abb-56c1-4cde-be96-56c80194c8df/serve-healthcheck-canary/0.log"
Jul 20 13:42:45.686812 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.686770    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"]
Jul 20 13:42:45.687291 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.687064    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87679bd4-e891-47df-95db-3f342730a5b4" containerName="registry"
Jul 20 13:42:45.687291 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.687075    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="87679bd4-e891-47df-95db-3f342730a5b4" containerName="registry"
Jul 20 13:42:45.687291 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.687127    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="87679bd4-e891-47df-95db-3f342730a5b4" containerName="registry"
Jul 20 13:42:45.689008 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.688992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:42:45.691367 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.691341    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 13:42:45.691367 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.691359    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jq7qh\""
Jul 20 13:42:45.691578 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.691347    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 13:42:45.699634 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.699610    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"]
Jul 20 13:42:45.798033 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.797992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9sr7\" (UniqueName: \"kubernetes.io/projected/c48c4d13-91b2-4d02-abe4-c39ca132136b-kube-api-access-c9sr7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc\" (UID: \"c48c4d13-91b2-4d02-abe4-c39ca132136b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:42:45.798033 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.798038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48c4d13-91b2-4d02-abe4-c39ca132136b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc\" (UID: \"c48c4d13-91b2-4d02-abe4-c39ca132136b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:42:45.798246 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.798119    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48c4d13-91b2-4d02-abe4-c39ca132136b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc\" (UID: \"c48c4d13-91b2-4d02-abe4-c39ca132136b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:42:45.899356 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.899298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48c4d13-91b2-4d02-abe4-c39ca132136b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc\" (UID: \"c48c4d13-91b2-4d02-abe4-c39ca132136b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:42:45.899557 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.899371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9sr7\" (UniqueName: \"kubernetes.io/projected/c48c4d13-91b2-4d02-abe4-c39ca132136b-kube-api-access-c9sr7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc\" (UID: \"c48c4d13-91b2-4d02-abe4-c39ca132136b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:42:45.899557 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.899395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48c4d13-91b2-4d02-abe4-c39ca132136b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc\" (UID: \"c48c4d13-91b2-4d02-abe4-c39ca132136b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:42:45.899804 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.899783    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48c4d13-91b2-4d02-abe4-c39ca132136b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc\" (UID: \"c48c4d13-91b2-4d02-abe4-c39ca132136b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:42:45.899840 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.899786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48c4d13-91b2-4d02-abe4-c39ca132136b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc\" (UID: \"c48c4d13-91b2-4d02-abe4-c39ca132136b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:42:45.908281 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.908253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9sr7\" (UniqueName: \"kubernetes.io/projected/c48c4d13-91b2-4d02-abe4-c39ca132136b-kube-api-access-c9sr7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc\" (UID: \"c48c4d13-91b2-4d02-abe4-c39ca132136b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:42:45.998602 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:45.998502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:42:46.129254 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:46.129232    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"]
Jul 20 13:42:46.131915 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:42:46.131889    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48c4d13_91b2_4d02_abe4_c39ca132136b.slice/crio-35e99631f270bdf923aee0978f3af35c0fc1260e5ef500081f2727d27e94f87c WatchSource:0}: Error finding container 35e99631f270bdf923aee0978f3af35c0fc1260e5ef500081f2727d27e94f87c: Status 404 returned error can't find the container with id 35e99631f270bdf923aee0978f3af35c0fc1260e5ef500081f2727d27e94f87c
Jul 20 13:42:46.155515 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:46.155422    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc" event={"ID":"c48c4d13-91b2-4d02-abe4-c39ca132136b","Type":"ContainerStarted","Data":"35e99631f270bdf923aee0978f3af35c0fc1260e5ef500081f2727d27e94f87c"}
Jul 20 13:42:53.183148 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:53.183113    2563 generic.go:356] "Generic (PLEG): container finished" podID="c48c4d13-91b2-4d02-abe4-c39ca132136b" containerID="6a17c1895ac7f70eb8d7cfa242be36254cf9063db96762808a43966a4638d10b" exitCode=0
Jul 20 13:42:53.183775 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:53.183158    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc" event={"ID":"c48c4d13-91b2-4d02-abe4-c39ca132136b","Type":"ContainerDied","Data":"6a17c1895ac7f70eb8d7cfa242be36254cf9063db96762808a43966a4638d10b"}
Jul 20 13:42:56.199893 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:56.199855    2563 generic.go:356] "Generic (PLEG): container finished" podID="c48c4d13-91b2-4d02-abe4-c39ca132136b" containerID="e30290a4e4853becb9d3e874fb4d98fce4684bafc723b7432a7a50b26b2c1632" exitCode=0
Jul 20 13:42:56.200335 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:42:56.199941    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc" event={"ID":"c48c4d13-91b2-4d02-abe4-c39ca132136b","Type":"ContainerDied","Data":"e30290a4e4853becb9d3e874fb4d98fce4684bafc723b7432a7a50b26b2c1632"}
Jul 20 13:43:04.234089 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:04.234048    2563 generic.go:356] "Generic (PLEG): container finished" podID="c48c4d13-91b2-4d02-abe4-c39ca132136b" containerID="74330a485e686e4cb6cf4b7046f798d1faaedc6fa32cd14038cb199909d1e98a" exitCode=0
Jul 20 13:43:04.234509 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:04.234087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc" event={"ID":"c48c4d13-91b2-4d02-abe4-c39ca132136b","Type":"ContainerDied","Data":"74330a485e686e4cb6cf4b7046f798d1faaedc6fa32cd14038cb199909d1e98a"}
Jul 20 13:43:05.367581 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:05.367550    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:43:05.449326 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:05.449287    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9sr7\" (UniqueName: \"kubernetes.io/projected/c48c4d13-91b2-4d02-abe4-c39ca132136b-kube-api-access-c9sr7\") pod \"c48c4d13-91b2-4d02-abe4-c39ca132136b\" (UID: \"c48c4d13-91b2-4d02-abe4-c39ca132136b\") "
Jul 20 13:43:05.449529 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:05.449344    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48c4d13-91b2-4d02-abe4-c39ca132136b-bundle\") pod \"c48c4d13-91b2-4d02-abe4-c39ca132136b\" (UID: \"c48c4d13-91b2-4d02-abe4-c39ca132136b\") "
Jul 20 13:43:05.449529 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:05.449379    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48c4d13-91b2-4d02-abe4-c39ca132136b-util\") pod \"c48c4d13-91b2-4d02-abe4-c39ca132136b\" (UID: \"c48c4d13-91b2-4d02-abe4-c39ca132136b\") "
Jul 20 13:43:05.450013 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:05.449986    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c48c4d13-91b2-4d02-abe4-c39ca132136b-bundle" (OuterVolumeSpecName: "bundle") pod "c48c4d13-91b2-4d02-abe4-c39ca132136b" (UID: "c48c4d13-91b2-4d02-abe4-c39ca132136b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:43:05.451692 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:05.451661    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c48c4d13-91b2-4d02-abe4-c39ca132136b-kube-api-access-c9sr7" (OuterVolumeSpecName: "kube-api-access-c9sr7") pod "c48c4d13-91b2-4d02-abe4-c39ca132136b" (UID: "c48c4d13-91b2-4d02-abe4-c39ca132136b"). InnerVolumeSpecName "kube-api-access-c9sr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:43:05.456346 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:05.456321    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c48c4d13-91b2-4d02-abe4-c39ca132136b-util" (OuterVolumeSpecName: "util") pod "c48c4d13-91b2-4d02-abe4-c39ca132136b" (UID: "c48c4d13-91b2-4d02-abe4-c39ca132136b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:43:05.550763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:05.550664    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48c4d13-91b2-4d02-abe4-c39ca132136b-util\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:43:05.550763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:05.550708    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9sr7\" (UniqueName: \"kubernetes.io/projected/c48c4d13-91b2-4d02-abe4-c39ca132136b-kube-api-access-c9sr7\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:43:05.550763 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:05.550719    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48c4d13-91b2-4d02-abe4-c39ca132136b-bundle\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:43:06.243278 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:06.243241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc" event={"ID":"c48c4d13-91b2-4d02-abe4-c39ca132136b","Type":"ContainerDied","Data":"35e99631f270bdf923aee0978f3af35c0fc1260e5ef500081f2727d27e94f87c"}
Jul 20 13:43:06.243278 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:06.243281    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrwfc"
Jul 20 13:43:06.243518 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:06.243295    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35e99631f270bdf923aee0978f3af35c0fc1260e5ef500081f2727d27e94f87c"
Jul 20 13:43:13.734209 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.734171    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z"]
Jul 20 13:43:13.734648 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.734443    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48c4d13-91b2-4d02-abe4-c39ca132136b" containerName="extract"
Jul 20 13:43:13.734648 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.734455    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48c4d13-91b2-4d02-abe4-c39ca132136b" containerName="extract"
Jul 20 13:43:13.734648 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.734465    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48c4d13-91b2-4d02-abe4-c39ca132136b" containerName="util"
Jul 20 13:43:13.734648 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.734472    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48c4d13-91b2-4d02-abe4-c39ca132136b" containerName="util"
Jul 20 13:43:13.734648 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.734483    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48c4d13-91b2-4d02-abe4-c39ca132136b" containerName="pull"
Jul 20 13:43:13.734648 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.734488    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48c4d13-91b2-4d02-abe4-c39ca132136b" containerName="pull"
Jul 20 13:43:13.734648 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.734530    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c48c4d13-91b2-4d02-abe4-c39ca132136b" containerName="extract"
Jul 20 13:43:13.737518 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.737503    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z"
Jul 20 13:43:13.740183 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.740155    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 20 13:43:13.740183 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.740166    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4t9hb\""
Jul 20 13:43:13.740360 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.740236    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:43:13.749839 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.749813    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z"]
Jul 20 13:43:13.810291 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.810254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng48v\" (UniqueName: \"kubernetes.io/projected/7e047534-7427-4012-98f1-c43674525d1c-kube-api-access-ng48v\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwz5z\" (UID: \"7e047534-7427-4012-98f1-c43674525d1c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z"
Jul 20 13:43:13.810291 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.810292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e047534-7427-4012-98f1-c43674525d1c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwz5z\" (UID: \"7e047534-7427-4012-98f1-c43674525d1c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z"
Jul 20 13:43:13.911214 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.911183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng48v\" (UniqueName: \"kubernetes.io/projected/7e047534-7427-4012-98f1-c43674525d1c-kube-api-access-ng48v\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwz5z\" (UID: \"7e047534-7427-4012-98f1-c43674525d1c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z"
Jul 20 13:43:13.911365 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.911222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e047534-7427-4012-98f1-c43674525d1c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwz5z\" (UID: \"7e047534-7427-4012-98f1-c43674525d1c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z"
Jul 20 13:43:13.911691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.911674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e047534-7427-4012-98f1-c43674525d1c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwz5z\" (UID: \"7e047534-7427-4012-98f1-c43674525d1c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z"
Jul 20 13:43:13.919513 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:13.919490    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng48v\" (UniqueName: \"kubernetes.io/projected/7e047534-7427-4012-98f1-c43674525d1c-kube-api-access-ng48v\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwz5z\" (UID: \"7e047534-7427-4012-98f1-c43674525d1c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z"
Jul 20 13:43:14.046598 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:14.046513    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z"
Jul 20 13:43:14.180782 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:14.180619    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z"]
Jul 20 13:43:14.183753 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:43:14.183724    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e047534_7427_4012_98f1_c43674525d1c.slice/crio-94c1015a799ebec6b4b23ce0a3109fd29707bde5ae6ab3314ce986daa560e375 WatchSource:0}: Error finding container 94c1015a799ebec6b4b23ce0a3109fd29707bde5ae6ab3314ce986daa560e375: Status 404 returned error can't find the container with id 94c1015a799ebec6b4b23ce0a3109fd29707bde5ae6ab3314ce986daa560e375
Jul 20 13:43:14.275498 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:14.275463    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z" event={"ID":"7e047534-7427-4012-98f1-c43674525d1c","Type":"ContainerStarted","Data":"94c1015a799ebec6b4b23ce0a3109fd29707bde5ae6ab3314ce986daa560e375"}
Jul 20 13:43:16.284353 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:16.284248    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z" event={"ID":"7e047534-7427-4012-98f1-c43674525d1c","Type":"ContainerStarted","Data":"10ab9812d2c4606d8fd8303a9c15e13f42ae84cc32d7517fae951e358d661673"}
Jul 20 13:43:16.308298 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:16.308244    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwz5z" podStartSLOduration=1.6740642079999999 podStartE2EDuration="3.308225517s" totalImagesPullingTime="1.634161309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:43:16.306046736 +0000 UTC m=+287.853618121" watchObservedRunningTime="2026-07-20 13:43:16.308225517 +0000 UTC m=+287.855796902"
Jul 20 13:43:17.379854 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.379816    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"]
Jul 20 13:43:17.383431 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.383388    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:17.386199 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.386175    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 13:43:17.386339 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.386172    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 13:43:17.387105 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.387086    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jq7qh\""
Jul 20 13:43:17.394294 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.394271    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"]
Jul 20 13:43:17.439756 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.439719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq\" (UID: \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:17.439942 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.439771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2hj8\" (UniqueName: \"kubernetes.io/projected/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-kube-api-access-w2hj8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq\" (UID: \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:17.439942 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.439819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq\" (UID: \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:17.541101 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.541063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2hj8\" (UniqueName: \"kubernetes.io/projected/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-kube-api-access-w2hj8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq\" (UID: \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:17.541279 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.541108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq\" (UID: \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:17.541279 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.541177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq\" (UID: \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:17.541617 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.541596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq\" (UID: \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:17.541701 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.541628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq\" (UID: \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:17.553459 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.553424    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2hj8\" (UniqueName: \"kubernetes.io/projected/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-kube-api-access-w2hj8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq\" (UID: \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:17.694530 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.694442    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:17.777058 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.776232    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4zr9l"]
Jul 20 13:43:17.779549 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.779526    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l"
Jul 20 13:43:17.781873 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.781843    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 13:43:17.782249 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.782213    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mqvvf\""
Jul 20 13:43:17.782841 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.782487    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 13:43:17.798439 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.794368    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4zr9l"]
Jul 20 13:43:17.839252 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.839226    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"]
Jul 20 13:43:17.841804 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:43:17.841775    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad597d8_662c_4cb6_b3d5_4a34346eec3b.slice/crio-829643459ffcdbbf97bd4f805065a53c5682442fc8ff6b6d93605cb545f74930 WatchSource:0}: Error finding container 829643459ffcdbbf97bd4f805065a53c5682442fc8ff6b6d93605cb545f74930: Status 404 returned error can't find the container with id 829643459ffcdbbf97bd4f805065a53c5682442fc8ff6b6d93605cb545f74930
Jul 20 13:43:17.843398 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.843328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b40d160-0572-4e5c-a499-703188f9ab9c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4zr9l\" (UID: \"0b40d160-0572-4e5c-a499-703188f9ab9c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l"
Jul 20 13:43:17.843398 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.843362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtf98\" (UniqueName: \"kubernetes.io/projected/0b40d160-0572-4e5c-a499-703188f9ab9c-kube-api-access-xtf98\") pod \"cert-manager-webhook-6486ffd997-4zr9l\" (UID: \"0b40d160-0572-4e5c-a499-703188f9ab9c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l"
Jul 20 13:43:17.944805 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.944734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b40d160-0572-4e5c-a499-703188f9ab9c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4zr9l\" (UID: \"0b40d160-0572-4e5c-a499-703188f9ab9c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l"
Jul 20 13:43:17.944805 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.944782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtf98\" (UniqueName: \"kubernetes.io/projected/0b40d160-0572-4e5c-a499-703188f9ab9c-kube-api-access-xtf98\") pod \"cert-manager-webhook-6486ffd997-4zr9l\" (UID: \"0b40d160-0572-4e5c-a499-703188f9ab9c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l"
Jul 20 13:43:17.952831 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.952801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b40d160-0572-4e5c-a499-703188f9ab9c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4zr9l\" (UID: \"0b40d160-0572-4e5c-a499-703188f9ab9c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l"
Jul 20 13:43:17.952966 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:17.952914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtf98\" (UniqueName: \"kubernetes.io/projected/0b40d160-0572-4e5c-a499-703188f9ab9c-kube-api-access-xtf98\") pod \"cert-manager-webhook-6486ffd997-4zr9l\" (UID: \"0b40d160-0572-4e5c-a499-703188f9ab9c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l"
Jul 20 13:43:18.092882 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:18.092840    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l"
Jul 20 13:43:18.225869 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:18.225793    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4zr9l"]
Jul 20 13:43:18.228670 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:43:18.228642    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b40d160_0572_4e5c_a499_703188f9ab9c.slice/crio-449c8f739aed551835da6ddb87a9aff00b52979d52074b151dd2ae0fee7ca0f5 WatchSource:0}: Error finding container 449c8f739aed551835da6ddb87a9aff00b52979d52074b151dd2ae0fee7ca0f5: Status 404 returned error can't find the container with id 449c8f739aed551835da6ddb87a9aff00b52979d52074b151dd2ae0fee7ca0f5
Jul 20 13:43:18.294301 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:18.294269    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l" event={"ID":"0b40d160-0572-4e5c-a499-703188f9ab9c","Type":"ContainerStarted","Data":"449c8f739aed551835da6ddb87a9aff00b52979d52074b151dd2ae0fee7ca0f5"}
Jul 20 13:43:18.295688 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:18.295660    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ad597d8-662c-4cb6-b3d5-4a34346eec3b" containerID="f34aef10a016e6cba8da18e4604d1e247f2eaa84cf1900a324143444dc97754d" exitCode=0
Jul 20 13:43:18.295809 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:18.295689    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq" event={"ID":"2ad597d8-662c-4cb6-b3d5-4a34346eec3b","Type":"ContainerDied","Data":"f34aef10a016e6cba8da18e4604d1e247f2eaa84cf1900a324143444dc97754d"}
Jul 20 13:43:18.295809 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:18.295727    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq" event={"ID":"2ad597d8-662c-4cb6-b3d5-4a34346eec3b","Type":"ContainerStarted","Data":"829643459ffcdbbf97bd4f805065a53c5682442fc8ff6b6d93605cb545f74930"}
Jul 20 13:43:22.314756 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:22.314723    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ad597d8-662c-4cb6-b3d5-4a34346eec3b" containerID="2c05fd1a2138b72b473f8eee43641fc7738fb0b325d5e841b30441cf386a840d" exitCode=0
Jul 20 13:43:22.315184 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:22.314816    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq" event={"ID":"2ad597d8-662c-4cb6-b3d5-4a34346eec3b","Type":"ContainerDied","Data":"2c05fd1a2138b72b473f8eee43641fc7738fb0b325d5e841b30441cf386a840d"}
Jul 20 13:43:22.316385 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:22.316361    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l" event={"ID":"0b40d160-0572-4e5c-a499-703188f9ab9c","Type":"ContainerStarted","Data":"241d3cbfcbf7d865098cdc3e3b389bb1503f0cf6cadf18ef7cb87a9bca81c417"}
Jul 20 13:43:22.316521 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:22.316470    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l"
Jul 20 13:43:22.349803 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:22.349753    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l" podStartSLOduration=1.9304173740000001 podStartE2EDuration="5.349738395s" totalImagesPullingTime="3.419321021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:43:22.348822972 +0000 UTC m=+293.896394361" watchObservedRunningTime="2026-07-20 13:43:22.349738395 +0000 UTC m=+293.897309780"
Jul 20 13:43:23.322710 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:23.322679    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ad597d8-662c-4cb6-b3d5-4a34346eec3b" containerID="64e796bc3eded4ca478b0a2492d49105f697bbf999c4d0b0a3c1abaa3e84d8c2" exitCode=0
Jul 20 13:43:23.323139 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:23.322768    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq" event={"ID":"2ad597d8-662c-4cb6-b3d5-4a34346eec3b","Type":"ContainerDied","Data":"64e796bc3eded4ca478b0a2492d49105f697bbf999c4d0b0a3c1abaa3e84d8c2"}
Jul 20 13:43:24.452582 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:24.452559    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:24.499702 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:24.499669    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-util\") pod \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\" (UID: \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\") "
Jul 20 13:43:24.499893 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:24.499711    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-bundle\") pod \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\" (UID: \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\") "
Jul 20 13:43:24.499893 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:24.499748    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2hj8\" (UniqueName: \"kubernetes.io/projected/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-kube-api-access-w2hj8\") pod \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\" (UID: \"2ad597d8-662c-4cb6-b3d5-4a34346eec3b\") "
Jul 20 13:43:24.500191 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:24.500154    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-bundle" (OuterVolumeSpecName: "bundle") pod "2ad597d8-662c-4cb6-b3d5-4a34346eec3b" (UID: "2ad597d8-662c-4cb6-b3d5-4a34346eec3b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:43:24.502126 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:24.502097    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-kube-api-access-w2hj8" (OuterVolumeSpecName: "kube-api-access-w2hj8") pod "2ad597d8-662c-4cb6-b3d5-4a34346eec3b" (UID: "2ad597d8-662c-4cb6-b3d5-4a34346eec3b"). InnerVolumeSpecName "kube-api-access-w2hj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:43:24.504330 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:24.504306    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-util" (OuterVolumeSpecName: "util") pod "2ad597d8-662c-4cb6-b3d5-4a34346eec3b" (UID: "2ad597d8-662c-4cb6-b3d5-4a34346eec3b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:43:24.600755 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:24.600667    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-util\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:43:24.600755 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:24.600700    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-bundle\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:43:24.600755 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:24.600717    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2hj8\" (UniqueName: \"kubernetes.io/projected/2ad597d8-662c-4cb6-b3d5-4a34346eec3b-kube-api-access-w2hj8\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:43:25.332421 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:25.332364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq" event={"ID":"2ad597d8-662c-4cb6-b3d5-4a34346eec3b","Type":"ContainerDied","Data":"829643459ffcdbbf97bd4f805065a53c5682442fc8ff6b6d93605cb545f74930"}
Jul 20 13:43:25.332602 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:25.332432    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frnspq"
Jul 20 13:43:25.332602 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:25.332450    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="829643459ffcdbbf97bd4f805065a53c5682442fc8ff6b6d93605cb545f74930"
Jul 20 13:43:28.325610 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:28.325580    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4zr9l"
Jul 20 13:43:28.811259 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:28.811178    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 13:43:37.327711 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.327677    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"]
Jul 20 13:43:37.372691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.327923    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ad597d8-662c-4cb6-b3d5-4a34346eec3b" containerName="util"
Jul 20 13:43:37.372691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.327934    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ad597d8-662c-4cb6-b3d5-4a34346eec3b" containerName="util"
Jul 20 13:43:37.372691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.327941    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ad597d8-662c-4cb6-b3d5-4a34346eec3b" containerName="pull"
Jul 20 13:43:37.372691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.327946    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ad597d8-662c-4cb6-b3d5-4a34346eec3b" containerName="pull"
Jul 20 13:43:37.372691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.327958    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ad597d8-662c-4cb6-b3d5-4a34346eec3b" containerName="extract"
Jul 20 13:43:37.372691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.327963    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ad597d8-662c-4cb6-b3d5-4a34346eec3b" containerName="extract"
Jul 20 13:43:37.372691 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.328005    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ad597d8-662c-4cb6-b3d5-4a34346eec3b" containerName="extract"
Jul 20 13:43:37.378022 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.377989    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"]
Jul 20 13:43:37.378195 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.378120    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:37.380867 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.380841    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 13:43:37.382091 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.382068    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jq7qh\""
Jul 20 13:43:37.382202 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.382125    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 13:43:37.506706 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.506676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/240aa528-3a21-4752-b6ce-73f402a29315-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw\" (UID: \"240aa528-3a21-4752-b6ce-73f402a29315\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:37.506706 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.506709    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf82z\" (UniqueName: \"kubernetes.io/projected/240aa528-3a21-4752-b6ce-73f402a29315-kube-api-access-hf82z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw\" (UID: \"240aa528-3a21-4752-b6ce-73f402a29315\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:37.506954 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.506752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/240aa528-3a21-4752-b6ce-73f402a29315-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw\" (UID: \"240aa528-3a21-4752-b6ce-73f402a29315\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:37.608274 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.608172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/240aa528-3a21-4752-b6ce-73f402a29315-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw\" (UID: \"240aa528-3a21-4752-b6ce-73f402a29315\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:37.608274 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.608229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf82z\" (UniqueName: \"kubernetes.io/projected/240aa528-3a21-4752-b6ce-73f402a29315-kube-api-access-hf82z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw\" (UID: \"240aa528-3a21-4752-b6ce-73f402a29315\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:37.608532 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.608282    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/240aa528-3a21-4752-b6ce-73f402a29315-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw\" (UID: \"240aa528-3a21-4752-b6ce-73f402a29315\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:37.608631 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.608613    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/240aa528-3a21-4752-b6ce-73f402a29315-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw\" (UID: \"240aa528-3a21-4752-b6ce-73f402a29315\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:37.608690 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.608665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/240aa528-3a21-4752-b6ce-73f402a29315-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw\" (UID: \"240aa528-3a21-4752-b6ce-73f402a29315\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:37.617347 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.617324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf82z\" (UniqueName: \"kubernetes.io/projected/240aa528-3a21-4752-b6ce-73f402a29315-kube-api-access-hf82z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw\" (UID: \"240aa528-3a21-4752-b6ce-73f402a29315\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:37.688328 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.688293    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:37.861734 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:37.861645    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"]
Jul 20 13:43:37.864852 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:43:37.864825    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240aa528_3a21_4752_b6ce_73f402a29315.slice/crio-05ca1a0aeb698de6b37487be35b22725479b7158ae989e40688cf2f6cf5397d7 WatchSource:0}: Error finding container 05ca1a0aeb698de6b37487be35b22725479b7158ae989e40688cf2f6cf5397d7: Status 404 returned error can't find the container with id 05ca1a0aeb698de6b37487be35b22725479b7158ae989e40688cf2f6cf5397d7
Jul 20 13:43:38.393068 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:38.393033    2563 generic.go:356] "Generic (PLEG): container finished" podID="240aa528-3a21-4752-b6ce-73f402a29315" containerID="6a6d231af84e6609ae4d9c3cc5cc71f377e6c010fc743d8c65c6480da2c00e8a" exitCode=0
Jul 20 13:43:38.393492 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:38.393116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw" event={"ID":"240aa528-3a21-4752-b6ce-73f402a29315","Type":"ContainerDied","Data":"6a6d231af84e6609ae4d9c3cc5cc71f377e6c010fc743d8c65c6480da2c00e8a"}
Jul 20 13:43:38.393492 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:38.393173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw" event={"ID":"240aa528-3a21-4752-b6ce-73f402a29315","Type":"ContainerStarted","Data":"05ca1a0aeb698de6b37487be35b22725479b7158ae989e40688cf2f6cf5397d7"}
Jul 20 13:43:38.393610 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:38.393595    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:43:39.399100 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:39.399062    2563 generic.go:356] "Generic (PLEG): container finished" podID="240aa528-3a21-4752-b6ce-73f402a29315" containerID="eaf279d4a605c980cb2436a898513ea175ef2001177a962e05c6f40ed3753a28" exitCode=0
Jul 20 13:43:39.399480 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:39.399154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw" event={"ID":"240aa528-3a21-4752-b6ce-73f402a29315","Type":"ContainerDied","Data":"eaf279d4a605c980cb2436a898513ea175ef2001177a962e05c6f40ed3753a28"}
Jul 20 13:43:40.405309 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:40.405272    2563 generic.go:356] "Generic (PLEG): container finished" podID="240aa528-3a21-4752-b6ce-73f402a29315" containerID="ed89308db9cd1f2234dcf80b1ba7914b705f16afd3f41aad1d442498cea88932" exitCode=0
Jul 20 13:43:40.405779 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:40.405352    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw" event={"ID":"240aa528-3a21-4752-b6ce-73f402a29315","Type":"ContainerDied","Data":"ed89308db9cd1f2234dcf80b1ba7914b705f16afd3f41aad1d442498cea88932"}
Jul 20 13:43:41.529549 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:41.529526    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:41.640240 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:41.640207    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/240aa528-3a21-4752-b6ce-73f402a29315-util\") pod \"240aa528-3a21-4752-b6ce-73f402a29315\" (UID: \"240aa528-3a21-4752-b6ce-73f402a29315\") "
Jul 20 13:43:41.640428 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:41.640291    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf82z\" (UniqueName: \"kubernetes.io/projected/240aa528-3a21-4752-b6ce-73f402a29315-kube-api-access-hf82z\") pod \"240aa528-3a21-4752-b6ce-73f402a29315\" (UID: \"240aa528-3a21-4752-b6ce-73f402a29315\") "
Jul 20 13:43:41.640428 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:41.640330    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/240aa528-3a21-4752-b6ce-73f402a29315-bundle\") pod \"240aa528-3a21-4752-b6ce-73f402a29315\" (UID: \"240aa528-3a21-4752-b6ce-73f402a29315\") "
Jul 20 13:43:41.641033 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:41.641004    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240aa528-3a21-4752-b6ce-73f402a29315-bundle" (OuterVolumeSpecName: "bundle") pod "240aa528-3a21-4752-b6ce-73f402a29315" (UID: "240aa528-3a21-4752-b6ce-73f402a29315"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:43:41.642534 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:41.642505    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240aa528-3a21-4752-b6ce-73f402a29315-kube-api-access-hf82z" (OuterVolumeSpecName: "kube-api-access-hf82z") pod "240aa528-3a21-4752-b6ce-73f402a29315" (UID: "240aa528-3a21-4752-b6ce-73f402a29315"). InnerVolumeSpecName "kube-api-access-hf82z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:43:41.645838 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:41.645814    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240aa528-3a21-4752-b6ce-73f402a29315-util" (OuterVolumeSpecName: "util") pod "240aa528-3a21-4752-b6ce-73f402a29315" (UID: "240aa528-3a21-4752-b6ce-73f402a29315"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:43:41.741513 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:41.741387    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf82z\" (UniqueName: \"kubernetes.io/projected/240aa528-3a21-4752-b6ce-73f402a29315-kube-api-access-hf82z\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:43:41.741513 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:41.741454    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/240aa528-3a21-4752-b6ce-73f402a29315-bundle\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:43:41.741513 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:41.741465    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/240aa528-3a21-4752-b6ce-73f402a29315-util\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:43:42.414829 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:42.414791    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw" event={"ID":"240aa528-3a21-4752-b6ce-73f402a29315","Type":"ContainerDied","Data":"05ca1a0aeb698de6b37487be35b22725479b7158ae989e40688cf2f6cf5397d7"}
Jul 20 13:43:42.414829 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:42.414817    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2pvdw"
Jul 20 13:43:42.414829 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:42.414836    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05ca1a0aeb698de6b37487be35b22725479b7158ae989e40688cf2f6cf5397d7"
Jul 20 13:43:54.118751 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.118710    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"]
Jul 20 13:43:54.119309 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.119055    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240aa528-3a21-4752-b6ce-73f402a29315" containerName="extract"
Jul 20 13:43:54.119309 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.119072    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="240aa528-3a21-4752-b6ce-73f402a29315" containerName="extract"
Jul 20 13:43:54.119309 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.119096    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240aa528-3a21-4752-b6ce-73f402a29315" containerName="pull"
Jul 20 13:43:54.119309 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.119106    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="240aa528-3a21-4752-b6ce-73f402a29315" containerName="pull"
Jul 20 13:43:54.119309 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.119124    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240aa528-3a21-4752-b6ce-73f402a29315" containerName="util"
Jul 20 13:43:54.119309 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.119132    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="240aa528-3a21-4752-b6ce-73f402a29315" containerName="util"
Jul 20 13:43:54.119309 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.119210    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="240aa528-3a21-4752-b6ce-73f402a29315" containerName="extract"
Jul 20 13:43:54.124979 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.123319    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.126142 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.126121    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 13:43:54.126266 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.126157    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-khdv6\""
Jul 20 13:43:54.128917 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.128901    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 13:43:54.129512 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.129496    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 13:43:54.129586 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.129531    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 13:43:54.139661 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.139638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"]
Jul 20 13:43:54.238307 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.238266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9463dde-c44b-4f82-b0d5-abb1f197c81f-manifests\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.238307 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.238307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6dsr\" (UniqueName: \"kubernetes.io/projected/d9463dde-c44b-4f82-b0d5-abb1f197c81f-kube-api-access-v6dsr\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.238560 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.238339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9463dde-c44b-4f82-b0d5-abb1f197c81f-tmp\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.238560 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.238454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9463dde-c44b-4f82-b0d5-abb1f197c81f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.238560 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.238482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9463dde-c44b-4f82-b0d5-abb1f197c81f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.339447 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.339386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9463dde-c44b-4f82-b0d5-abb1f197c81f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.339447 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.339449    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9463dde-c44b-4f82-b0d5-abb1f197c81f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.339663 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.339517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9463dde-c44b-4f82-b0d5-abb1f197c81f-manifests\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.339663 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.339643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6dsr\" (UniqueName: \"kubernetes.io/projected/d9463dde-c44b-4f82-b0d5-abb1f197c81f-kube-api-access-v6dsr\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.339741 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.339688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9463dde-c44b-4f82-b0d5-abb1f197c81f-tmp\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.339924 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.339903    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9463dde-c44b-4f82-b0d5-abb1f197c81f-manifests\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.342104 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.342077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9463dde-c44b-4f82-b0d5-abb1f197c81f-tmp\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.342398 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.342376    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9463dde-c44b-4f82-b0d5-abb1f197c81f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.342474 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.342422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9463dde-c44b-4f82-b0d5-abb1f197c81f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.350126 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.350106    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6dsr\" (UniqueName: \"kubernetes.io/projected/d9463dde-c44b-4f82-b0d5-abb1f197c81f-kube-api-access-v6dsr\") pod \"opendatahub-operator-controller-manager-5b98c56445-6qt7q\" (UID: \"d9463dde-c44b-4f82-b0d5-abb1f197c81f\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.435102 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.435012    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:43:54.584394 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:54.584355    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"]
Jul 20 13:43:54.588870 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:43:54.588845    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9463dde_c44b_4f82_b0d5_abb1f197c81f.slice/crio-8045e543a17bc6ae8be9cf30f477c4bc02b38db95b6750b88ef860d518241439 WatchSource:0}: Error finding container 8045e543a17bc6ae8be9cf30f477c4bc02b38db95b6750b88ef860d518241439: Status 404 returned error can't find the container with id 8045e543a17bc6ae8be9cf30f477c4bc02b38db95b6750b88ef860d518241439
Jul 20 13:43:55.471492 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:55.471452    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q" event={"ID":"d9463dde-c44b-4f82-b0d5-abb1f197c81f","Type":"ContainerStarted","Data":"8045e543a17bc6ae8be9cf30f477c4bc02b38db95b6750b88ef860d518241439"}
Jul 20 13:43:58.486257 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:58.486224    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q" event={"ID":"d9463dde-c44b-4f82-b0d5-abb1f197c81f","Type":"ContainerStarted","Data":"15acf92feae030094db7be7eae838afd25f1c87b9681a1abe763bc0fff933e1e"}
Jul 20 13:43:59.497079 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:59.497039    2563 generic.go:356] "Generic (PLEG): container finished" podID="d9463dde-c44b-4f82-b0d5-abb1f197c81f" containerID="15acf92feae030094db7be7eae838afd25f1c87b9681a1abe763bc0fff933e1e" exitCode=0
Jul 20 13:43:59.497576 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:43:59.497111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q" event={"ID":"d9463dde-c44b-4f82-b0d5-abb1f197c81f","Type":"ContainerDied","Data":"15acf92feae030094db7be7eae838afd25f1c87b9681a1abe763bc0fff933e1e"}
Jul 20 13:44:00.505215 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:00.505175    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q" event={"ID":"d9463dde-c44b-4f82-b0d5-abb1f197c81f","Type":"ContainerStarted","Data":"ee4ffa7bc8c60d56df55a14856f83b29978ee40c9b7d9429e172831a10797f26"}
Jul 20 13:44:00.505743 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:00.505315    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:44:00.528698 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:00.528641    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q" podStartSLOduration=2.077261591 podStartE2EDuration="6.528621952s" totalImagesPullingTime="3.418983106s" totalInitContainerRuntime="1.032377255s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:43:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:44:00.527501443 +0000 UTC m=+332.075072831" watchObservedRunningTime="2026-07-20 13:44:00.528621952 +0000 UTC m=+332.076193337"
Jul 20 13:44:11.511671 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:11.511641    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-6qt7q"
Jul 20 13:44:14.504279 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.504236    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z4kmf"]
Jul 20 13:44:14.512470 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.512444    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf"
Jul 20 13:44:14.515043 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.515014    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 20 13:44:14.515043 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.515031    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hkjmj\""
Jul 20 13:44:14.520354 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.520328    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z4kmf"]
Jul 20 13:44:14.704004 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.703962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s9v9\" (UniqueName: \"kubernetes.io/projected/75228171-e3fa-4278-bf73-63c66b43069d-kube-api-access-2s9v9\") pod \"odh-model-controller-7998c67dc4-z4kmf\" (UID: \"75228171-e3fa-4278-bf73-63c66b43069d\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf"
Jul 20 13:44:14.704206 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.704028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75228171-e3fa-4278-bf73-63c66b43069d-cert\") pod \"odh-model-controller-7998c67dc4-z4kmf\" (UID: \"75228171-e3fa-4278-bf73-63c66b43069d\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf"
Jul 20 13:44:14.804749 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.804654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s9v9\" (UniqueName: \"kubernetes.io/projected/75228171-e3fa-4278-bf73-63c66b43069d-kube-api-access-2s9v9\") pod \"odh-model-controller-7998c67dc4-z4kmf\" (UID: \"75228171-e3fa-4278-bf73-63c66b43069d\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf"
Jul 20 13:44:14.804749 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.804734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75228171-e3fa-4278-bf73-63c66b43069d-cert\") pod \"odh-model-controller-7998c67dc4-z4kmf\" (UID: \"75228171-e3fa-4278-bf73-63c66b43069d\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf"
Jul 20 13:44:14.807441 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.807383    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75228171-e3fa-4278-bf73-63c66b43069d-cert\") pod \"odh-model-controller-7998c67dc4-z4kmf\" (UID: \"75228171-e3fa-4278-bf73-63c66b43069d\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf"
Jul 20 13:44:14.817735 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.817705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s9v9\" (UniqueName: \"kubernetes.io/projected/75228171-e3fa-4278-bf73-63c66b43069d-kube-api-access-2s9v9\") pod \"odh-model-controller-7998c67dc4-z4kmf\" (UID: \"75228171-e3fa-4278-bf73-63c66b43069d\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf"
Jul 20 13:44:14.824367 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.824341    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf"
Jul 20 13:44:14.971574 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:14.971466    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z4kmf"]
Jul 20 13:44:14.974180 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:44:14.974137    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75228171_e3fa_4278_bf73_63c66b43069d.slice/crio-e949abfe8cae55763eacbd4998a491a3aef3a8c3e85d2ff12915ce5f42a59347 WatchSource:0}: Error finding container e949abfe8cae55763eacbd4998a491a3aef3a8c3e85d2ff12915ce5f42a59347: Status 404 returned error can't find the container with id e949abfe8cae55763eacbd4998a491a3aef3a8c3e85d2ff12915ce5f42a59347
Jul 20 13:44:15.182047 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.182006    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-26xpb"]
Jul 20 13:44:15.187031 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.187008    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-26xpb"
Jul 20 13:44:15.189422 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.189387    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 20 13:44:15.198590 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.198566    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-26xpb"]
Jul 20 13:44:15.308656 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.308616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fwhg\" (UniqueName: \"kubernetes.io/projected/5a67b31e-7ed0-429c-ba74-917addd7ab3a-kube-api-access-9fwhg\") pod \"model-serving-api-54d89bd5fc-26xpb\" (UID: \"5a67b31e-7ed0-429c-ba74-917addd7ab3a\") " pod="opendatahub/model-serving-api-54d89bd5fc-26xpb"
Jul 20 13:44:15.308858 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.308724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a67b31e-7ed0-429c-ba74-917addd7ab3a-tls-certs\") pod \"model-serving-api-54d89bd5fc-26xpb\" (UID: \"5a67b31e-7ed0-429c-ba74-917addd7ab3a\") " pod="opendatahub/model-serving-api-54d89bd5fc-26xpb"
Jul 20 13:44:15.409630 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.409574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwhg\" (UniqueName: \"kubernetes.io/projected/5a67b31e-7ed0-429c-ba74-917addd7ab3a-kube-api-access-9fwhg\") pod \"model-serving-api-54d89bd5fc-26xpb\" (UID: \"5a67b31e-7ed0-429c-ba74-917addd7ab3a\") " pod="opendatahub/model-serving-api-54d89bd5fc-26xpb"
Jul 20 13:44:15.409810 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.409666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a67b31e-7ed0-429c-ba74-917addd7ab3a-tls-certs\") pod \"model-serving-api-54d89bd5fc-26xpb\" (UID: \"5a67b31e-7ed0-429c-ba74-917addd7ab3a\") " pod="opendatahub/model-serving-api-54d89bd5fc-26xpb"
Jul 20 13:44:15.412237 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.412216    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a67b31e-7ed0-429c-ba74-917addd7ab3a-tls-certs\") pod \"model-serving-api-54d89bd5fc-26xpb\" (UID: \"5a67b31e-7ed0-429c-ba74-917addd7ab3a\") " pod="opendatahub/model-serving-api-54d89bd5fc-26xpb"
Jul 20 13:44:15.418321 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.418300    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fwhg\" (UniqueName: \"kubernetes.io/projected/5a67b31e-7ed0-429c-ba74-917addd7ab3a-kube-api-access-9fwhg\") pod \"model-serving-api-54d89bd5fc-26xpb\" (UID: \"5a67b31e-7ed0-429c-ba74-917addd7ab3a\") " pod="opendatahub/model-serving-api-54d89bd5fc-26xpb"
Jul 20 13:44:15.498284 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.498198    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-26xpb"
Jul 20 13:44:15.572379 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.572298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf" event={"ID":"75228171-e3fa-4278-bf73-63c66b43069d","Type":"ContainerStarted","Data":"e949abfe8cae55763eacbd4998a491a3aef3a8c3e85d2ff12915ce5f42a59347"}
Jul 20 13:44:15.698221 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:15.698139    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-26xpb"]
Jul 20 13:44:15.702435 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:44:15.702368    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a67b31e_7ed0_429c_ba74_917addd7ab3a.slice/crio-3e537793e821198b8954da4847a80d41fd34d70c5bd6cb17353b018f45d0e896 WatchSource:0}: Error finding container 3e537793e821198b8954da4847a80d41fd34d70c5bd6cb17353b018f45d0e896: Status 404 returned error can't find the container with id 3e537793e821198b8954da4847a80d41fd34d70c5bd6cb17353b018f45d0e896
Jul 20 13:44:16.580135 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:16.580093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-26xpb" event={"ID":"5a67b31e-7ed0-429c-ba74-917addd7ab3a","Type":"ContainerStarted","Data":"3e537793e821198b8954da4847a80d41fd34d70c5bd6cb17353b018f45d0e896"}
Jul 20 13:44:18.590119 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:18.590077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-26xpb" event={"ID":"5a67b31e-7ed0-429c-ba74-917addd7ab3a","Type":"ContainerStarted","Data":"14e70d9253fceb70cfcc1505725f2a9a53e7726ca86b51e97fb4d0967e64e325"}
Jul 20 13:44:18.590577 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:18.590141    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-26xpb"
Jul 20 13:44:18.591568 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:18.591545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf" event={"ID":"75228171-e3fa-4278-bf73-63c66b43069d","Type":"ContainerStarted","Data":"ba1260b1a30591628f5320e85256328fe7b1d1516d24ab49f6517bac19a9ae19"}
Jul 20 13:44:18.591701 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:18.591687    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf"
Jul 20 13:44:18.606203 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:18.606156    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-26xpb" podStartSLOduration=1.344075754 podStartE2EDuration="3.606141339s" totalImagesPullingTime="2.262065585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:44:18.604747913 +0000 UTC m=+350.152319298" watchObservedRunningTime="2026-07-20 13:44:18.606141339 +0000 UTC m=+350.153712701"
Jul 20 13:44:18.622099 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:18.622041    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf" podStartSLOduration=1.627584074 podStartE2EDuration="4.622022762s" totalImagesPullingTime="2.994438688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:44:18.62118276 +0000 UTC m=+350.168754158" watchObservedRunningTime="2026-07-20 13:44:18.622022762 +0000 UTC m=+350.169594149"
Jul 20 13:44:19.871908 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:19.871816    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"]
Jul 20 13:44:19.875204 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:19.875178    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"
Jul 20 13:44:19.879186 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:19.879158    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 13:44:19.879335 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:19.879183    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 13:44:19.880281 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:19.880260    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b6bpz\""
Jul 20 13:44:19.894642 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:19.894606    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"]
Jul 20 13:44:19.951871 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:19.951831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjzgv\" (UniqueName: \"kubernetes.io/projected/21fc6bd7-3f3b-4148-bfda-6e296ea13475-kube-api-access-cjzgv\") pod \"kube-auth-proxy-8667c86565-fpxkz\" (UID: \"21fc6bd7-3f3b-4148-bfda-6e296ea13475\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"
Jul 20 13:44:19.951871 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:19.951869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21fc6bd7-3f3b-4148-bfda-6e296ea13475-tmp\") pod \"kube-auth-proxy-8667c86565-fpxkz\" (UID: \"21fc6bd7-3f3b-4148-bfda-6e296ea13475\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"
Jul 20 13:44:19.952079 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:19.951902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21fc6bd7-3f3b-4148-bfda-6e296ea13475-tls-certs\") pod \"kube-auth-proxy-8667c86565-fpxkz\" (UID: \"21fc6bd7-3f3b-4148-bfda-6e296ea13475\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"
Jul 20 13:44:20.052942 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:20.052909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21fc6bd7-3f3b-4148-bfda-6e296ea13475-tls-certs\") pod \"kube-auth-proxy-8667c86565-fpxkz\" (UID: \"21fc6bd7-3f3b-4148-bfda-6e296ea13475\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"
Jul 20 13:44:20.053108 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:20.053001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjzgv\" (UniqueName: \"kubernetes.io/projected/21fc6bd7-3f3b-4148-bfda-6e296ea13475-kube-api-access-cjzgv\") pod \"kube-auth-proxy-8667c86565-fpxkz\" (UID: \"21fc6bd7-3f3b-4148-bfda-6e296ea13475\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"
Jul 20 13:44:20.053108 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:20.053027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21fc6bd7-3f3b-4148-bfda-6e296ea13475-tmp\") pod \"kube-auth-proxy-8667c86565-fpxkz\" (UID: \"21fc6bd7-3f3b-4148-bfda-6e296ea13475\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"
Jul 20 13:44:20.055505 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:20.055480    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21fc6bd7-3f3b-4148-bfda-6e296ea13475-tmp\") pod \"kube-auth-proxy-8667c86565-fpxkz\" (UID: \"21fc6bd7-3f3b-4148-bfda-6e296ea13475\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"
Jul 20 13:44:20.055809 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:20.055789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21fc6bd7-3f3b-4148-bfda-6e296ea13475-tls-certs\") pod \"kube-auth-proxy-8667c86565-fpxkz\" (UID: \"21fc6bd7-3f3b-4148-bfda-6e296ea13475\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"
Jul 20 13:44:20.064179 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:20.064147    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjzgv\" (UniqueName: \"kubernetes.io/projected/21fc6bd7-3f3b-4148-bfda-6e296ea13475-kube-api-access-cjzgv\") pod \"kube-auth-proxy-8667c86565-fpxkz\" (UID: \"21fc6bd7-3f3b-4148-bfda-6e296ea13475\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"
Jul 20 13:44:20.187573 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:20.187488    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"
Jul 20 13:44:20.325091 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:20.325069    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8667c86565-fpxkz"]
Jul 20 13:44:20.327099 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:44:20.327068    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fc6bd7_3f3b_4148_bfda_6e296ea13475.slice/crio-81901dbd753603043475f607a18553c8437cf92847ab36854114a390f2dd1f24 WatchSource:0}: Error finding container 81901dbd753603043475f607a18553c8437cf92847ab36854114a390f2dd1f24: Status 404 returned error can't find the container with id 81901dbd753603043475f607a18553c8437cf92847ab36854114a390f2dd1f24
Jul 20 13:44:20.602928 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:20.602891    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz" event={"ID":"21fc6bd7-3f3b-4148-bfda-6e296ea13475","Type":"ContainerStarted","Data":"81901dbd753603043475f607a18553c8437cf92847ab36854114a390f2dd1f24"}
Jul 20 13:44:21.565870 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.565828    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"]
Jul 20 13:44:21.576353 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.575948    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.578359 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.578333    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 13:44:21.579040 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.579020    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 13:44:21.579617 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.579431    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 13:44:21.579617 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.579532    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 13:44:21.580488 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.580465    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d8rmp\""
Jul 20 13:44:21.580605 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.580512    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:44:21.588817 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.588788    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"]
Jul 20 13:44:21.665688 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.665654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6aae345e-9b99-4801-8731-dd15047bd1e9-cert\") pod \"lws-controller-manager-6d5f789bb4-66mjq\" (UID: \"6aae345e-9b99-4801-8731-dd15047bd1e9\") " pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.665887 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.665729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z94h7\" (UniqueName: \"kubernetes.io/projected/6aae345e-9b99-4801-8731-dd15047bd1e9-kube-api-access-z94h7\") pod \"lws-controller-manager-6d5f789bb4-66mjq\" (UID: \"6aae345e-9b99-4801-8731-dd15047bd1e9\") " pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.665887 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.665807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6aae345e-9b99-4801-8731-dd15047bd1e9-metrics-cert\") pod \"lws-controller-manager-6d5f789bb4-66mjq\" (UID: \"6aae345e-9b99-4801-8731-dd15047bd1e9\") " pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.665887 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.665855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6aae345e-9b99-4801-8731-dd15047bd1e9-manager-config\") pod \"lws-controller-manager-6d5f789bb4-66mjq\" (UID: \"6aae345e-9b99-4801-8731-dd15047bd1e9\") " pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.766644 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.766611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6aae345e-9b99-4801-8731-dd15047bd1e9-metrics-cert\") pod \"lws-controller-manager-6d5f789bb4-66mjq\" (UID: \"6aae345e-9b99-4801-8731-dd15047bd1e9\") " pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.766840 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.766652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6aae345e-9b99-4801-8731-dd15047bd1e9-manager-config\") pod \"lws-controller-manager-6d5f789bb4-66mjq\" (UID: \"6aae345e-9b99-4801-8731-dd15047bd1e9\") " pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.766840 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.766701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6aae345e-9b99-4801-8731-dd15047bd1e9-cert\") pod \"lws-controller-manager-6d5f789bb4-66mjq\" (UID: \"6aae345e-9b99-4801-8731-dd15047bd1e9\") " pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.766840 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.766745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z94h7\" (UniqueName: \"kubernetes.io/projected/6aae345e-9b99-4801-8731-dd15047bd1e9-kube-api-access-z94h7\") pod \"lws-controller-manager-6d5f789bb4-66mjq\" (UID: \"6aae345e-9b99-4801-8731-dd15047bd1e9\") " pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.767645 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.767613    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6aae345e-9b99-4801-8731-dd15047bd1e9-manager-config\") pod \"lws-controller-manager-6d5f789bb4-66mjq\" (UID: \"6aae345e-9b99-4801-8731-dd15047bd1e9\") " pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.769756 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.769725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6aae345e-9b99-4801-8731-dd15047bd1e9-cert\") pod \"lws-controller-manager-6d5f789bb4-66mjq\" (UID: \"6aae345e-9b99-4801-8731-dd15047bd1e9\") " pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.769860 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.769836    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6aae345e-9b99-4801-8731-dd15047bd1e9-metrics-cert\") pod \"lws-controller-manager-6d5f789bb4-66mjq\" (UID: \"6aae345e-9b99-4801-8731-dd15047bd1e9\") " pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.780580 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.780546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z94h7\" (UniqueName: \"kubernetes.io/projected/6aae345e-9b99-4801-8731-dd15047bd1e9-kube-api-access-z94h7\") pod \"lws-controller-manager-6d5f789bb4-66mjq\" (UID: \"6aae345e-9b99-4801-8731-dd15047bd1e9\") " pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:21.889672 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:21.889635    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:22.047826 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:22.047799    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"]
Jul 20 13:44:22.050226 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:44:22.050195    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aae345e_9b99_4801_8731_dd15047bd1e9.slice/crio-0bf7f68f9b77f836c20d12ffbb9b3439eb97180661c0c50636c726ebb342b0d9 WatchSource:0}: Error finding container 0bf7f68f9b77f836c20d12ffbb9b3439eb97180661c0c50636c726ebb342b0d9: Status 404 returned error can't find the container with id 0bf7f68f9b77f836c20d12ffbb9b3439eb97180661c0c50636c726ebb342b0d9
Jul 20 13:44:22.615213 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:22.615161    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq" event={"ID":"6aae345e-9b99-4801-8731-dd15047bd1e9","Type":"ContainerStarted","Data":"0bf7f68f9b77f836c20d12ffbb9b3439eb97180661c0c50636c726ebb342b0d9"}
Jul 20 13:44:23.621654 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:23.621306    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz" event={"ID":"21fc6bd7-3f3b-4148-bfda-6e296ea13475","Type":"ContainerStarted","Data":"bffa2709f2f5b168c65bd20df268d899ea72c90ea28331b88d041a7e55df3e43"}
Jul 20 13:44:23.638581 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:23.638526    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8667c86565-fpxkz" podStartSLOduration=2.062998621 podStartE2EDuration="4.638504221s" totalImagesPullingTime="2.5755056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:44:23.636928699 +0000 UTC m=+355.184500085" watchObservedRunningTime="2026-07-20 13:44:23.638504221 +0000 UTC m=+355.186075608"
Jul 20 13:44:24.627014 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:24.626978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq" event={"ID":"6aae345e-9b99-4801-8731-dd15047bd1e9","Type":"ContainerStarted","Data":"d362656cef348e258682d2b46076f381b31fd207e82d5e6c3af78d52d0ff9aa8"}
Jul 20 13:44:24.657715 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:24.657664    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq" podStartSLOduration=1.844443247 podStartE2EDuration="3.657648269s" totalImagesPullingTime="1.813205022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:44:24.656729246 +0000 UTC m=+356.204300631" watchObservedRunningTime="2026-07-20 13:44:24.657648269 +0000 UTC m=+356.205219728"
Jul 20 13:44:25.632877 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:25.632848    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:44:29.599571 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:29.599539    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-z4kmf"
Jul 20 13:44:29.601677 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:29.601655    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-26xpb"
Jul 20 13:44:36.639287 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:44:36.639255    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d5f789bb4-66mjq"
Jul 20 13:45:31.115133 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.115098    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"]
Jul 20 13:45:31.117696 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.117674    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:31.119956 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.119936    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bg7tx\""
Jul 20 13:45:31.120224 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.120201    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 13:45:31.120934 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.120916    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 13:45:31.127199 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.127178    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"]
Jul 20 13:45:31.220962 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.220925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwhrr\" (UniqueName: \"kubernetes.io/projected/c6e0a6c3-135c-46dd-9097-eb2ac742659f-kube-api-access-hwhrr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b\" (UID: \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:31.221129 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.220970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6e0a6c3-135c-46dd-9097-eb2ac742659f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b\" (UID: \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:31.221129 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.221073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6e0a6c3-135c-46dd-9097-eb2ac742659f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b\" (UID: \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:31.321703 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.321663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhrr\" (UniqueName: \"kubernetes.io/projected/c6e0a6c3-135c-46dd-9097-eb2ac742659f-kube-api-access-hwhrr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b\" (UID: \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:31.321703 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.321711    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6e0a6c3-135c-46dd-9097-eb2ac742659f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b\" (UID: \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:31.321892 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.321756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6e0a6c3-135c-46dd-9097-eb2ac742659f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b\" (UID: \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:31.322175 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.322154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6e0a6c3-135c-46dd-9097-eb2ac742659f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b\" (UID: \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:31.322175 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.322167    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6e0a6c3-135c-46dd-9097-eb2ac742659f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b\" (UID: \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:31.329936 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.329904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwhrr\" (UniqueName: \"kubernetes.io/projected/c6e0a6c3-135c-46dd-9097-eb2ac742659f-kube-api-access-hwhrr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b\" (UID: \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:31.427717 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.427634    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:31.563220 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.563185    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"]
Jul 20 13:45:31.566441 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:45:31.566394    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e0a6c3_135c_46dd_9097_eb2ac742659f.slice/crio-be575e7537d5723357accccf423a9d93cbba458c8c815a547385291b62b95b41 WatchSource:0}: Error finding container be575e7537d5723357accccf423a9d93cbba458c8c815a547385291b62b95b41: Status 404 returned error can't find the container with id be575e7537d5723357accccf423a9d93cbba458c8c815a547385291b62b95b41
Jul 20 13:45:31.712906 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.712820    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"]
Jul 20 13:45:31.715325 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.715301    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:31.724940 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.724909    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"]
Jul 20 13:45:31.826136 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.826097    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t\" (UID: \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:31.826308 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.826142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t\" (UID: \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:31.826308 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.826229    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg6mf\" (UniqueName: \"kubernetes.io/projected/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-kube-api-access-qg6mf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t\" (UID: \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:31.918546 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.918516    2563 generic.go:356] "Generic (PLEG): container finished" podID="c6e0a6c3-135c-46dd-9097-eb2ac742659f" containerID="4669ef67231ab21ce20a0e8f7e300d95e940fbbd1d0e0cf59f52349e585c6ff4" exitCode=0
Jul 20 13:45:31.918733 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.918593    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b" event={"ID":"c6e0a6c3-135c-46dd-9097-eb2ac742659f","Type":"ContainerDied","Data":"4669ef67231ab21ce20a0e8f7e300d95e940fbbd1d0e0cf59f52349e585c6ff4"}
Jul 20 13:45:31.918733 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.918641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b" event={"ID":"c6e0a6c3-135c-46dd-9097-eb2ac742659f","Type":"ContainerStarted","Data":"be575e7537d5723357accccf423a9d93cbba458c8c815a547385291b62b95b41"}
Jul 20 13:45:31.926610 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.926587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg6mf\" (UniqueName: \"kubernetes.io/projected/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-kube-api-access-qg6mf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t\" (UID: \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:31.926747 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.926623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t\" (UID: \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:31.926747 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.926645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t\" (UID: \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:31.927025 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.927005    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t\" (UID: \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:31.927065 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.927044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t\" (UID: \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:31.937472 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:31.937451    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg6mf\" (UniqueName: \"kubernetes.io/projected/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-kube-api-access-qg6mf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t\" (UID: \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:32.046967 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.046881    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:32.116125 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.116097    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"]
Jul 20 13:45:32.118805 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.118782    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:32.132062 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.132030    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"]
Jul 20 13:45:32.183441 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.183397    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"]
Jul 20 13:45:32.185752 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:45:32.185722    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b93db6f_8c64_469e_8e8f_bb9cd074ba62.slice/crio-93ac6e7e3c137d4334a2316c15de5793cc1562153b9bd6936363eda8bc671185 WatchSource:0}: Error finding container 93ac6e7e3c137d4334a2316c15de5793cc1562153b9bd6936363eda8bc671185: Status 404 returned error can't find the container with id 93ac6e7e3c137d4334a2316c15de5793cc1562153b9bd6936363eda8bc671185
Jul 20 13:45:32.229859 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.229830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f6e7f0d-ab74-4739-90cb-d45d895f0927-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj\" (UID: \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:32.229995 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.229882    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f6e7f0d-ab74-4739-90cb-d45d895f0927-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj\" (UID: \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:32.229995 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.229935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2t85\" (UniqueName: \"kubernetes.io/projected/8f6e7f0d-ab74-4739-90cb-d45d895f0927-kube-api-access-g2t85\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj\" (UID: \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:32.330331 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.330295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f6e7f0d-ab74-4739-90cb-d45d895f0927-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj\" (UID: \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:32.330671 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.330354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2t85\" (UniqueName: \"kubernetes.io/projected/8f6e7f0d-ab74-4739-90cb-d45d895f0927-kube-api-access-g2t85\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj\" (UID: \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:32.330671 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.330397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f6e7f0d-ab74-4739-90cb-d45d895f0927-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj\" (UID: \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:32.330794 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.330775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f6e7f0d-ab74-4739-90cb-d45d895f0927-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj\" (UID: \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:32.330854 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.330835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f6e7f0d-ab74-4739-90cb-d45d895f0927-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj\" (UID: \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:32.339611 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.339582    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2t85\" (UniqueName: \"kubernetes.io/projected/8f6e7f0d-ab74-4739-90cb-d45d895f0927-kube-api-access-g2t85\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj\" (UID: \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:32.427776 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.427742    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:32.517115 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.517071    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"]
Jul 20 13:45:32.519743 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.519699    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:32.532108 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.532047    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"]
Jul 20 13:45:32.571138 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.571115    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"]
Jul 20 13:45:32.572820 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:45:32.572795    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f6e7f0d_ab74_4739_90cb_d45d895f0927.slice/crio-6b66f6501ef2bf4557df0d40acab90c36a1a03cc6b9c3aae3e59b639d3366893 WatchSource:0}: Error finding container 6b66f6501ef2bf4557df0d40acab90c36a1a03cc6b9c3aae3e59b639d3366893: Status 404 returned error can't find the container with id 6b66f6501ef2bf4557df0d40acab90c36a1a03cc6b9c3aae3e59b639d3366893
Jul 20 13:45:32.632980 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.632934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chmlh\" (UniqueName: \"kubernetes.io/projected/33a5a356-a65e-4073-860f-7c1a5d82c214-kube-api-access-chmlh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t\" (UID: \"33a5a356-a65e-4073-860f-7c1a5d82c214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:32.633183 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.633009    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33a5a356-a65e-4073-860f-7c1a5d82c214-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t\" (UID: \"33a5a356-a65e-4073-860f-7c1a5d82c214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:32.633183 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.633085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33a5a356-a65e-4073-860f-7c1a5d82c214-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t\" (UID: \"33a5a356-a65e-4073-860f-7c1a5d82c214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:32.733976 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.733942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chmlh\" (UniqueName: \"kubernetes.io/projected/33a5a356-a65e-4073-860f-7c1a5d82c214-kube-api-access-chmlh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t\" (UID: \"33a5a356-a65e-4073-860f-7c1a5d82c214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:32.734112 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.734028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33a5a356-a65e-4073-860f-7c1a5d82c214-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t\" (UID: \"33a5a356-a65e-4073-860f-7c1a5d82c214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:32.734112 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.734062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33a5a356-a65e-4073-860f-7c1a5d82c214-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t\" (UID: \"33a5a356-a65e-4073-860f-7c1a5d82c214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:32.734430 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.734383    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33a5a356-a65e-4073-860f-7c1a5d82c214-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t\" (UID: \"33a5a356-a65e-4073-860f-7c1a5d82c214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:32.734510 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.734450    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33a5a356-a65e-4073-860f-7c1a5d82c214-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t\" (UID: \"33a5a356-a65e-4073-860f-7c1a5d82c214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:32.742559 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.742541    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chmlh\" (UniqueName: \"kubernetes.io/projected/33a5a356-a65e-4073-860f-7c1a5d82c214-kube-api-access-chmlh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t\" (UID: \"33a5a356-a65e-4073-860f-7c1a5d82c214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:32.830510 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.830476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:32.927086 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.927056    2563 generic.go:356] "Generic (PLEG): container finished" podID="c6e0a6c3-135c-46dd-9097-eb2ac742659f" containerID="cc3f4769f842926a5a3c4fe01bee717afb45f184993a20b8bdd8e3b1b6088827" exitCode=0
Jul 20 13:45:32.927264 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.927130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b" event={"ID":"c6e0a6c3-135c-46dd-9097-eb2ac742659f","Type":"ContainerDied","Data":"cc3f4769f842926a5a3c4fe01bee717afb45f184993a20b8bdd8e3b1b6088827"}
Jul 20 13:45:32.928855 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.928718    2563 generic.go:356] "Generic (PLEG): container finished" podID="8f6e7f0d-ab74-4739-90cb-d45d895f0927" containerID="f282321a5f05a0822a16bfc7bff2a212944e8c627b9cb0e66c81680bd715518a" exitCode=0
Jul 20 13:45:32.928855 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.928799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj" event={"ID":"8f6e7f0d-ab74-4739-90cb-d45d895f0927","Type":"ContainerDied","Data":"f282321a5f05a0822a16bfc7bff2a212944e8c627b9cb0e66c81680bd715518a"}
Jul 20 13:45:32.928855 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.928853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj" event={"ID":"8f6e7f0d-ab74-4739-90cb-d45d895f0927","Type":"ContainerStarted","Data":"6b66f6501ef2bf4557df0d40acab90c36a1a03cc6b9c3aae3e59b639d3366893"}
Jul 20 13:45:32.930965 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.930940    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b93db6f-8c64-469e-8e8f-bb9cd074ba62" containerID="48c30aabba460e14fbbeb045685b141ee23516428e29732fae99b101d591981b" exitCode=0
Jul 20 13:45:32.931083 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.930995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t" event={"ID":"5b93db6f-8c64-469e-8e8f-bb9cd074ba62","Type":"ContainerDied","Data":"48c30aabba460e14fbbeb045685b141ee23516428e29732fae99b101d591981b"}
Jul 20 13:45:32.931083 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.931024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t" event={"ID":"5b93db6f-8c64-469e-8e8f-bb9cd074ba62","Type":"ContainerStarted","Data":"93ac6e7e3c137d4334a2316c15de5793cc1562153b9bd6936363eda8bc671185"}
Jul 20 13:45:32.967164 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:32.967137    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"]
Jul 20 13:45:32.970547 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:45:32.970516    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a5a356_a65e_4073_860f_7c1a5d82c214.slice/crio-ef64d3a2f79ec54e4d0fca04b11ca35041d5455e98b542012cce49302f760c0b WatchSource:0}: Error finding container ef64d3a2f79ec54e4d0fca04b11ca35041d5455e98b542012cce49302f760c0b: Status 404 returned error can't find the container with id ef64d3a2f79ec54e4d0fca04b11ca35041d5455e98b542012cce49302f760c0b
Jul 20 13:45:33.936926 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:33.936884    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b93db6f-8c64-469e-8e8f-bb9cd074ba62" containerID="e5b64f05c6fd43326aa37f18d0523472337bd63a230bfa3a6e73a021f75a3d1c" exitCode=0
Jul 20 13:45:33.937309 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:33.936961    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t" event={"ID":"5b93db6f-8c64-469e-8e8f-bb9cd074ba62","Type":"ContainerDied","Data":"e5b64f05c6fd43326aa37f18d0523472337bd63a230bfa3a6e73a021f75a3d1c"}
Jul 20 13:45:33.938664 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:33.938642    2563 generic.go:356] "Generic (PLEG): container finished" podID="33a5a356-a65e-4073-860f-7c1a5d82c214" containerID="b046a7d529d8aa62073db7e11623325cf542310c5a083ea87053d7819f53875a" exitCode=0
Jul 20 13:45:33.938780 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:33.938724    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t" event={"ID":"33a5a356-a65e-4073-860f-7c1a5d82c214","Type":"ContainerDied","Data":"b046a7d529d8aa62073db7e11623325cf542310c5a083ea87053d7819f53875a"}
Jul 20 13:45:33.938780 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:33.938771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t" event={"ID":"33a5a356-a65e-4073-860f-7c1a5d82c214","Type":"ContainerStarted","Data":"ef64d3a2f79ec54e4d0fca04b11ca35041d5455e98b542012cce49302f760c0b"}
Jul 20 13:45:33.941071 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:33.940972    2563 generic.go:356] "Generic (PLEG): container finished" podID="c6e0a6c3-135c-46dd-9097-eb2ac742659f" containerID="20eba349e5775527d98d019b3b7b5827408df282fde8b39a6fa2a8e7d51fa7a4" exitCode=0
Jul 20 13:45:33.941071 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:33.941022    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b" event={"ID":"c6e0a6c3-135c-46dd-9097-eb2ac742659f","Type":"ContainerDied","Data":"20eba349e5775527d98d019b3b7b5827408df282fde8b39a6fa2a8e7d51fa7a4"}
Jul 20 13:45:34.948648 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:34.948552    2563 generic.go:356] "Generic (PLEG): container finished" podID="8f6e7f0d-ab74-4739-90cb-d45d895f0927" containerID="a1896f27775da3a1a84c2d90265f8f9c380aa736b083ee4fde7798d9d67fc533" exitCode=0
Jul 20 13:45:34.948648 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:34.948631    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj" event={"ID":"8f6e7f0d-ab74-4739-90cb-d45d895f0927","Type":"ContainerDied","Data":"a1896f27775da3a1a84c2d90265f8f9c380aa736b083ee4fde7798d9d67fc533"}
Jul 20 13:45:34.950740 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:34.950721    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b93db6f-8c64-469e-8e8f-bb9cd074ba62" containerID="d3b8f8c062825bffc45fcd96163e65fb86d958bd5da762346a218ea03b1c7edc" exitCode=0
Jul 20 13:45:34.950831 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:34.950793    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t" event={"ID":"5b93db6f-8c64-469e-8e8f-bb9cd074ba62","Type":"ContainerDied","Data":"d3b8f8c062825bffc45fcd96163e65fb86d958bd5da762346a218ea03b1c7edc"}
Jul 20 13:45:34.952390 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:34.952373    2563 generic.go:356] "Generic (PLEG): container finished" podID="33a5a356-a65e-4073-860f-7c1a5d82c214" containerID="579b6c92be6152dfa0d841d9135e109ac798e3b6fe82860ce15fa56f85cd80be" exitCode=0
Jul 20 13:45:34.952482 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:34.952443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t" event={"ID":"33a5a356-a65e-4073-860f-7c1a5d82c214","Type":"ContainerDied","Data":"579b6c92be6152dfa0d841d9135e109ac798e3b6fe82860ce15fa56f85cd80be"}
Jul 20 13:45:35.085693 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.085669    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:35.155570 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.155538    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwhrr\" (UniqueName: \"kubernetes.io/projected/c6e0a6c3-135c-46dd-9097-eb2ac742659f-kube-api-access-hwhrr\") pod \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\" (UID: \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\") "
Jul 20 13:45:35.155684 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.155595    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6e0a6c3-135c-46dd-9097-eb2ac742659f-bundle\") pod \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\" (UID: \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\") "
Jul 20 13:45:35.155684 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.155612    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6e0a6c3-135c-46dd-9097-eb2ac742659f-util\") pod \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\" (UID: \"c6e0a6c3-135c-46dd-9097-eb2ac742659f\") "
Jul 20 13:45:35.156056 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.156024    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e0a6c3-135c-46dd-9097-eb2ac742659f-bundle" (OuterVolumeSpecName: "bundle") pod "c6e0a6c3-135c-46dd-9097-eb2ac742659f" (UID: "c6e0a6c3-135c-46dd-9097-eb2ac742659f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:45:35.157875 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.157853    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6e0a6c3-135c-46dd-9097-eb2ac742659f-kube-api-access-hwhrr" (OuterVolumeSpecName: "kube-api-access-hwhrr") pod "c6e0a6c3-135c-46dd-9097-eb2ac742659f" (UID: "c6e0a6c3-135c-46dd-9097-eb2ac742659f"). InnerVolumeSpecName "kube-api-access-hwhrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:45:35.160761 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.160740    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e0a6c3-135c-46dd-9097-eb2ac742659f-util" (OuterVolumeSpecName: "util") pod "c6e0a6c3-135c-46dd-9097-eb2ac742659f" (UID: "c6e0a6c3-135c-46dd-9097-eb2ac742659f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:45:35.256938 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.256858    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwhrr\" (UniqueName: \"kubernetes.io/projected/c6e0a6c3-135c-46dd-9097-eb2ac742659f-kube-api-access-hwhrr\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:45:35.256938 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.256890    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6e0a6c3-135c-46dd-9097-eb2ac742659f-bundle\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:45:35.256938 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.256898    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6e0a6c3-135c-46dd-9097-eb2ac742659f-util\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:45:35.958746 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.958710    2563 generic.go:356] "Generic (PLEG): container finished" podID="33a5a356-a65e-4073-860f-7c1a5d82c214" containerID="d84f6498c9073d2ed1cf2f8e624bcb65c5b4dc3c7a167cf2d94c613d3e8715e4" exitCode=0
Jul 20 13:45:35.959235 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.958810    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t" event={"ID":"33a5a356-a65e-4073-860f-7c1a5d82c214","Type":"ContainerDied","Data":"d84f6498c9073d2ed1cf2f8e624bcb65c5b4dc3c7a167cf2d94c613d3e8715e4"}
Jul 20 13:45:35.960982 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.960955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b" event={"ID":"c6e0a6c3-135c-46dd-9097-eb2ac742659f","Type":"ContainerDied","Data":"be575e7537d5723357accccf423a9d93cbba458c8c815a547385291b62b95b41"}
Jul 20 13:45:35.961117 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.961000    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be575e7537d5723357accccf423a9d93cbba458c8c815a547385291b62b95b41"
Jul 20 13:45:35.961117 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.960966    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b"
Jul 20 13:45:35.962986 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.962965    2563 generic.go:356] "Generic (PLEG): container finished" podID="8f6e7f0d-ab74-4739-90cb-d45d895f0927" containerID="6831d77136d8b0b0874e5a13b16225342a09a15a04c15626aaba8029f9c7fe5b" exitCode=0
Jul 20 13:45:35.963099 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:35.963049    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj" event={"ID":"8f6e7f0d-ab74-4739-90cb-d45d895f0927","Type":"ContainerDied","Data":"6831d77136d8b0b0874e5a13b16225342a09a15a04c15626aaba8029f9c7fe5b"}
Jul 20 13:45:36.094638 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.094614    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:36.162978 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.162945    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-bundle\") pod \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\" (UID: \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\") "
Jul 20 13:45:36.163170 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.163017    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-util\") pod \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\" (UID: \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\") "
Jul 20 13:45:36.163170 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.163046    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg6mf\" (UniqueName: \"kubernetes.io/projected/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-kube-api-access-qg6mf\") pod \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\" (UID: \"5b93db6f-8c64-469e-8e8f-bb9cd074ba62\") "
Jul 20 13:45:36.163503 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.163456    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-bundle" (OuterVolumeSpecName: "bundle") pod "5b93db6f-8c64-469e-8e8f-bb9cd074ba62" (UID: "5b93db6f-8c64-469e-8e8f-bb9cd074ba62"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:45:36.165275 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.165248    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-kube-api-access-qg6mf" (OuterVolumeSpecName: "kube-api-access-qg6mf") pod "5b93db6f-8c64-469e-8e8f-bb9cd074ba62" (UID: "5b93db6f-8c64-469e-8e8f-bb9cd074ba62"). InnerVolumeSpecName "kube-api-access-qg6mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:45:36.168553 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.168513    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-util" (OuterVolumeSpecName: "util") pod "5b93db6f-8c64-469e-8e8f-bb9cd074ba62" (UID: "5b93db6f-8c64-469e-8e8f-bb9cd074ba62"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:45:36.264676 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.264589    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-bundle\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:45:36.264676 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.264623    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-util\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:45:36.264676 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.264632    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg6mf\" (UniqueName: \"kubernetes.io/projected/5b93db6f-8c64-469e-8e8f-bb9cd074ba62-kube-api-access-qg6mf\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:45:36.969331 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.969301    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t"
Jul 20 13:45:36.969726 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.969333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t" event={"ID":"5b93db6f-8c64-469e-8e8f-bb9cd074ba62","Type":"ContainerDied","Data":"93ac6e7e3c137d4334a2316c15de5793cc1562153b9bd6936363eda8bc671185"}
Jul 20 13:45:36.969726 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:36.969382    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93ac6e7e3c137d4334a2316c15de5793cc1562153b9bd6936363eda8bc671185"
Jul 20 13:45:37.107313 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.107292    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:37.122832 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.122811    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:37.172743 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.172703    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f6e7f0d-ab74-4739-90cb-d45d895f0927-util\") pod \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\" (UID: \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\") "
Jul 20 13:45:37.172914 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.172782    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33a5a356-a65e-4073-860f-7c1a5d82c214-bundle\") pod \"33a5a356-a65e-4073-860f-7c1a5d82c214\" (UID: \"33a5a356-a65e-4073-860f-7c1a5d82c214\") "
Jul 20 13:45:37.172914 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.172805    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f6e7f0d-ab74-4739-90cb-d45d895f0927-bundle\") pod \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\" (UID: \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\") "
Jul 20 13:45:37.172914 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.172825    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chmlh\" (UniqueName: \"kubernetes.io/projected/33a5a356-a65e-4073-860f-7c1a5d82c214-kube-api-access-chmlh\") pod \"33a5a356-a65e-4073-860f-7c1a5d82c214\" (UID: \"33a5a356-a65e-4073-860f-7c1a5d82c214\") "
Jul 20 13:45:37.172914 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.172912    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2t85\" (UniqueName: \"kubernetes.io/projected/8f6e7f0d-ab74-4739-90cb-d45d895f0927-kube-api-access-g2t85\") pod \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\" (UID: \"8f6e7f0d-ab74-4739-90cb-d45d895f0927\") "
Jul 20 13:45:37.173144 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.172936    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33a5a356-a65e-4073-860f-7c1a5d82c214-util\") pod \"33a5a356-a65e-4073-860f-7c1a5d82c214\" (UID: \"33a5a356-a65e-4073-860f-7c1a5d82c214\") "
Jul 20 13:45:37.173470 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.173399    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f6e7f0d-ab74-4739-90cb-d45d895f0927-bundle" (OuterVolumeSpecName: "bundle") pod "8f6e7f0d-ab74-4739-90cb-d45d895f0927" (UID: "8f6e7f0d-ab74-4739-90cb-d45d895f0927"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:45:37.173702 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.173670    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a5a356-a65e-4073-860f-7c1a5d82c214-bundle" (OuterVolumeSpecName: "bundle") pod "33a5a356-a65e-4073-860f-7c1a5d82c214" (UID: "33a5a356-a65e-4073-860f-7c1a5d82c214"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:45:37.175325 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.175296    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33a5a356-a65e-4073-860f-7c1a5d82c214-kube-api-access-chmlh" (OuterVolumeSpecName: "kube-api-access-chmlh") pod "33a5a356-a65e-4073-860f-7c1a5d82c214" (UID: "33a5a356-a65e-4073-860f-7c1a5d82c214"). InnerVolumeSpecName "kube-api-access-chmlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:45:37.175661 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.175639    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f6e7f0d-ab74-4739-90cb-d45d895f0927-kube-api-access-g2t85" (OuterVolumeSpecName: "kube-api-access-g2t85") pod "8f6e7f0d-ab74-4739-90cb-d45d895f0927" (UID: "8f6e7f0d-ab74-4739-90cb-d45d895f0927"). InnerVolumeSpecName "kube-api-access-g2t85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:45:37.178652 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.178620    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a5a356-a65e-4073-860f-7c1a5d82c214-util" (OuterVolumeSpecName: "util") pod "33a5a356-a65e-4073-860f-7c1a5d82c214" (UID: "33a5a356-a65e-4073-860f-7c1a5d82c214"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:45:37.178796 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.178773    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f6e7f0d-ab74-4739-90cb-d45d895f0927-util" (OuterVolumeSpecName: "util") pod "8f6e7f0d-ab74-4739-90cb-d45d895f0927" (UID: "8f6e7f0d-ab74-4739-90cb-d45d895f0927"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:45:37.274464 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.274377    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33a5a356-a65e-4073-860f-7c1a5d82c214-bundle\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:45:37.274464 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.274400    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f6e7f0d-ab74-4739-90cb-d45d895f0927-bundle\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:45:37.274464 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.274426    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chmlh\" (UniqueName: \"kubernetes.io/projected/33a5a356-a65e-4073-860f-7c1a5d82c214-kube-api-access-chmlh\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:45:37.274464 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.274439    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2t85\" (UniqueName: \"kubernetes.io/projected/8f6e7f0d-ab74-4739-90cb-d45d895f0927-kube-api-access-g2t85\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:45:37.274464 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.274452    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33a5a356-a65e-4073-860f-7c1a5d82c214-util\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:45:37.274464 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.274459    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f6e7f0d-ab74-4739-90cb-d45d895f0927-util\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:45:37.975278 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.975252    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj"
Jul 20 13:45:37.975751 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.975286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj" event={"ID":"8f6e7f0d-ab74-4739-90cb-d45d895f0927","Type":"ContainerDied","Data":"6b66f6501ef2bf4557df0d40acab90c36a1a03cc6b9c3aae3e59b639d3366893"}
Jul 20 13:45:37.975751 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.975333    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b66f6501ef2bf4557df0d40acab90c36a1a03cc6b9c3aae3e59b639d3366893"
Jul 20 13:45:37.977126 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.977096    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t" event={"ID":"33a5a356-a65e-4073-860f-7c1a5d82c214","Type":"ContainerDied","Data":"ef64d3a2f79ec54e4d0fca04b11ca35041d5455e98b542012cce49302f760c0b"}
Jul 20 13:45:37.977126 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.977120    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t"
Jul 20 13:45:37.977310 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:45:37.977136    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef64d3a2f79ec54e4d0fca04b11ca35041d5455e98b542012cce49302f760c0b"
Jul 20 13:47:02.163418 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163367    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163669    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a5a356-a65e-4073-860f-7c1a5d82c214" containerName="extract"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163679    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a5a356-a65e-4073-860f-7c1a5d82c214" containerName="extract"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163690    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e0a6c3-135c-46dd-9097-eb2ac742659f" containerName="pull"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163696    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e0a6c3-135c-46dd-9097-eb2ac742659f" containerName="pull"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163702    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a5a356-a65e-4073-860f-7c1a5d82c214" containerName="util"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163708    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a5a356-a65e-4073-860f-7c1a5d82c214" containerName="util"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163717    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b93db6f-8c64-469e-8e8f-bb9cd074ba62" containerName="pull"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163721    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b93db6f-8c64-469e-8e8f-bb9cd074ba62" containerName="pull"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163730    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b93db6f-8c64-469e-8e8f-bb9cd074ba62" containerName="extract"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163736    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b93db6f-8c64-469e-8e8f-bb9cd074ba62" containerName="extract"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163742    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6e7f0d-ab74-4739-90cb-d45d895f0927" containerName="util"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163747    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6e7f0d-ab74-4739-90cb-d45d895f0927" containerName="util"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163754    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e0a6c3-135c-46dd-9097-eb2ac742659f" containerName="extract"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163759    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e0a6c3-135c-46dd-9097-eb2ac742659f" containerName="extract"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163763    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6e7f0d-ab74-4739-90cb-d45d895f0927" containerName="extract"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163767    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6e7f0d-ab74-4739-90cb-d45d895f0927" containerName="extract"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163773    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6e7f0d-ab74-4739-90cb-d45d895f0927" containerName="pull"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163777    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6e7f0d-ab74-4739-90cb-d45d895f0927" containerName="pull"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163783    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a5a356-a65e-4073-860f-7c1a5d82c214" containerName="pull"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163787    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a5a356-a65e-4073-860f-7c1a5d82c214" containerName="pull"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163794    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e0a6c3-135c-46dd-9097-eb2ac742659f" containerName="util"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163798    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e0a6c3-135c-46dd-9097-eb2ac742659f" containerName="util"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163808    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b93db6f-8c64-469e-8e8f-bb9cd074ba62" containerName="util"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163812    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b93db6f-8c64-469e-8e8f-bb9cd074ba62" containerName="util"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163863    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="33a5a356-a65e-4073-860f-7c1a5d82c214" containerName="extract"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163868    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6e0a6c3-135c-46dd-9097-eb2ac742659f" containerName="extract"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163876    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b93db6f-8c64-469e-8e8f-bb9cd074ba62" containerName="extract"
Jul 20 13:47:02.163898 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.163881    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f6e7f0d-ab74-4739-90cb-d45d895f0927" containerName="extract"
Jul 20 13:47:02.166657 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.166641    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"
Jul 20 13:47:02.168912 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.168888    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bg7tx\""
Jul 20 13:47:02.169104 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.169081    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 13:47:02.169891 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.169874    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 13:47:02.169941 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.169875    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 13:47:02.174880 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.174856    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:47:02.202321 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.202285    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:47:02.248044 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.248006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss9sc\" (UniqueName: \"kubernetes.io/projected/fc9a8824-a161-4494-9da6-ac3791937918-kube-api-access-ss9sc\") pod \"limitador-limitador-54d6d988d5-mdpwf\" (UID: \"fc9a8824-a161-4494-9da6-ac3791937918\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"
Jul 20 13:47:02.248202 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.248073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc9a8824-a161-4494-9da6-ac3791937918-config-file\") pod \"limitador-limitador-54d6d988d5-mdpwf\" (UID: \"fc9a8824-a161-4494-9da6-ac3791937918\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"
Jul 20 13:47:02.349480 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.349437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc9a8824-a161-4494-9da6-ac3791937918-config-file\") pod \"limitador-limitador-54d6d988d5-mdpwf\" (UID: \"fc9a8824-a161-4494-9da6-ac3791937918\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"
Jul 20 13:47:02.349669 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.349528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9sc\" (UniqueName: \"kubernetes.io/projected/fc9a8824-a161-4494-9da6-ac3791937918-kube-api-access-ss9sc\") pod \"limitador-limitador-54d6d988d5-mdpwf\" (UID: \"fc9a8824-a161-4494-9da6-ac3791937918\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"
Jul 20 13:47:02.350002 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.349985    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc9a8824-a161-4494-9da6-ac3791937918-config-file\") pod \"limitador-limitador-54d6d988d5-mdpwf\" (UID: \"fc9a8824-a161-4494-9da6-ac3791937918\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"
Jul 20 13:47:02.357427 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.357388    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss9sc\" (UniqueName: \"kubernetes.io/projected/fc9a8824-a161-4494-9da6-ac3791937918-kube-api-access-ss9sc\") pod \"limitador-limitador-54d6d988d5-mdpwf\" (UID: \"fc9a8824-a161-4494-9da6-ac3791937918\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"
Jul 20 13:47:02.477881 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.477789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"
Jul 20 13:47:02.617115 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.614307    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:47:02.620592 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:47:02.620552    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9a8824_a161_4494_9da6_ac3791937918.slice/crio-ec8f44f89c1c5c743af8e5b83d3ec4df4ad5bc328fdfd5d2f18132748f760a4f WatchSource:0}: Error finding container ec8f44f89c1c5c743af8e5b83d3ec4df4ad5bc328fdfd5d2f18132748f760a4f: Status 404 returned error can't find the container with id ec8f44f89c1c5c743af8e5b83d3ec4df4ad5bc328fdfd5d2f18132748f760a4f
Jul 20 13:47:02.811985 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.811903    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dzj9p"]
Jul 20 13:47:02.816279 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.816262    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dzj9p"
Jul 20 13:47:02.818824 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.818803    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-45rxl\""
Jul 20 13:47:02.822311 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.822286    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dzj9p"]
Jul 20 13:47:02.955568 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:02.955535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqsk7\" (UniqueName: \"kubernetes.io/projected/0b7faf79-3578-41e5-b1aa-29599e521a52-kube-api-access-tqsk7\") pod \"authorino-75d556bd77-dzj9p\" (UID: \"0b7faf79-3578-41e5-b1aa-29599e521a52\") " pod="kuadrant-system/authorino-75d556bd77-dzj9p"
Jul 20 13:47:03.056507 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:03.056469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqsk7\" (UniqueName: \"kubernetes.io/projected/0b7faf79-3578-41e5-b1aa-29599e521a52-kube-api-access-tqsk7\") pod \"authorino-75d556bd77-dzj9p\" (UID: \"0b7faf79-3578-41e5-b1aa-29599e521a52\") " pod="kuadrant-system/authorino-75d556bd77-dzj9p"
Jul 20 13:47:03.064380 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:03.064304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqsk7\" (UniqueName: \"kubernetes.io/projected/0b7faf79-3578-41e5-b1aa-29599e521a52-kube-api-access-tqsk7\") pod \"authorino-75d556bd77-dzj9p\" (UID: \"0b7faf79-3578-41e5-b1aa-29599e521a52\") " pod="kuadrant-system/authorino-75d556bd77-dzj9p"
Jul 20 13:47:03.126269 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:03.126231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dzj9p"
Jul 20 13:47:03.308331 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:03.308298    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dzj9p"]
Jul 20 13:47:03.310732 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:47:03.310702    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b7faf79_3578_41e5_b1aa_29599e521a52.slice/crio-f544f41d5392deb86b6b9297b2ddbbe1b3ef00b14d2f691f20511b96a6067175 WatchSource:0}: Error finding container f544f41d5392deb86b6b9297b2ddbbe1b3ef00b14d2f691f20511b96a6067175: Status 404 returned error can't find the container with id f544f41d5392deb86b6b9297b2ddbbe1b3ef00b14d2f691f20511b96a6067175
Jul 20 13:47:03.364286 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:03.364185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf" event={"ID":"fc9a8824-a161-4494-9da6-ac3791937918","Type":"ContainerStarted","Data":"ec8f44f89c1c5c743af8e5b83d3ec4df4ad5bc328fdfd5d2f18132748f760a4f"}
Jul 20 13:47:03.366838 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:03.366771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dzj9p" event={"ID":"0b7faf79-3578-41e5-b1aa-29599e521a52","Type":"ContainerStarted","Data":"f544f41d5392deb86b6b9297b2ddbbe1b3ef00b14d2f691f20511b96a6067175"}
Jul 20 13:47:07.393866 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:07.393765    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dzj9p" event={"ID":"0b7faf79-3578-41e5-b1aa-29599e521a52","Type":"ContainerStarted","Data":"f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0"}
Jul 20 13:47:07.395387 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:07.395361    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf" event={"ID":"fc9a8824-a161-4494-9da6-ac3791937918","Type":"ContainerStarted","Data":"a954809235ea7e7c1c877251eb9d6707b0c9b1f136a2d87c452548e9e2e6abed"}
Jul 20 13:47:07.395553 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:07.395443    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"
Jul 20 13:47:07.413381 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:07.413335    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dzj9p" podStartSLOduration=1.588136822 podStartE2EDuration="5.413321669s" totalImagesPullingTime="3.825184847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:47:07.412363358 +0000 UTC m=+518.959934744" watchObservedRunningTime="2026-07-20 13:47:07.413321669 +0000 UTC m=+518.960893053"
Jul 20 13:47:07.433528 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:07.433475    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf" podStartSLOduration=0.923800607 podStartE2EDuration="5.433458349s" totalImagesPullingTime="4.509657742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:47:07.43237227 +0000 UTC m=+518.979943692" watchObservedRunningTime="2026-07-20 13:47:07.433458349 +0000 UTC m=+518.981029735"
Jul 20 13:47:18.401107 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:18.401071    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"
Jul 20 13:47:32.784015 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:32.783900    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-95b6bd676-nbq9n"]
Jul 20 13:47:32.787112 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:32.787090    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-95b6bd676-nbq9n"
Jul 20 13:47:32.794269 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:32.794243    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-95b6bd676-nbq9n"]
Jul 20 13:47:32.807674 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:32.807644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfvcn\" (UniqueName: \"kubernetes.io/projected/461fca2e-f582-4e70-9621-fa03eef1e07e-kube-api-access-sfvcn\") pod \"authorino-95b6bd676-nbq9n\" (UID: \"461fca2e-f582-4e70-9621-fa03eef1e07e\") " pod="kuadrant-system/authorino-95b6bd676-nbq9n"
Jul 20 13:47:32.908372 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:32.908326    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfvcn\" (UniqueName: \"kubernetes.io/projected/461fca2e-f582-4e70-9621-fa03eef1e07e-kube-api-access-sfvcn\") pod \"authorino-95b6bd676-nbq9n\" (UID: \"461fca2e-f582-4e70-9621-fa03eef1e07e\") " pod="kuadrant-system/authorino-95b6bd676-nbq9n"
Jul 20 13:47:32.918548 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:32.918517    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfvcn\" (UniqueName: \"kubernetes.io/projected/461fca2e-f582-4e70-9621-fa03eef1e07e-kube-api-access-sfvcn\") pod \"authorino-95b6bd676-nbq9n\" (UID: \"461fca2e-f582-4e70-9621-fa03eef1e07e\") " pod="kuadrant-system/authorino-95b6bd676-nbq9n"
Jul 20 13:47:33.096954 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:33.096916    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-95b6bd676-nbq9n"
Jul 20 13:47:33.233578 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:33.233552    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-95b6bd676-nbq9n"]
Jul 20 13:47:33.235699 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:47:33.235671    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod461fca2e_f582_4e70_9621_fa03eef1e07e.slice/crio-08ec0aa35301b1deef641430b8a9b0a735d4c77e133afe2d7cfc356d3e82a96d WatchSource:0}: Error finding container 08ec0aa35301b1deef641430b8a9b0a735d4c77e133afe2d7cfc356d3e82a96d: Status 404 returned error can't find the container with id 08ec0aa35301b1deef641430b8a9b0a735d4c77e133afe2d7cfc356d3e82a96d
Jul 20 13:47:33.517023 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:33.516936    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-95b6bd676-nbq9n" event={"ID":"461fca2e-f582-4e70-9621-fa03eef1e07e","Type":"ContainerStarted","Data":"08ec0aa35301b1deef641430b8a9b0a735d4c77e133afe2d7cfc356d3e82a96d"}
Jul 20 13:47:34.523548 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:34.523515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-95b6bd676-nbq9n" event={"ID":"461fca2e-f582-4e70-9621-fa03eef1e07e","Type":"ContainerStarted","Data":"0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17"}
Jul 20 13:47:34.545277 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:34.545219    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-95b6bd676-nbq9n" podStartSLOduration=2.146245357 podStartE2EDuration="2.545203629s" totalImagesPullingTime="398.958272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:47:34.543328933 +0000 UTC m=+546.090900318" watchObservedRunningTime="2026-07-20 13:47:34.545203629 +0000 UTC m=+546.092775014"
Jul 20 13:47:34.578395 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:34.578358    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dzj9p"]
Jul 20 13:47:34.578639 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:34.578559    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dzj9p" podUID="0b7faf79-3578-41e5-b1aa-29599e521a52" containerName="authorino" containerID="cri-o://f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0" gracePeriod=30
Jul 20 13:47:34.825324 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:34.825300    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dzj9p"
Jul 20 13:47:34.925536 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:34.925502    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqsk7\" (UniqueName: \"kubernetes.io/projected/0b7faf79-3578-41e5-b1aa-29599e521a52-kube-api-access-tqsk7\") pod \"0b7faf79-3578-41e5-b1aa-29599e521a52\" (UID: \"0b7faf79-3578-41e5-b1aa-29599e521a52\") "
Jul 20 13:47:34.927840 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:34.927811    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b7faf79-3578-41e5-b1aa-29599e521a52-kube-api-access-tqsk7" (OuterVolumeSpecName: "kube-api-access-tqsk7") pod "0b7faf79-3578-41e5-b1aa-29599e521a52" (UID: "0b7faf79-3578-41e5-b1aa-29599e521a52"). InnerVolumeSpecName "kube-api-access-tqsk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:47:35.027104 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:35.027059    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqsk7\" (UniqueName: \"kubernetes.io/projected/0b7faf79-3578-41e5-b1aa-29599e521a52-kube-api-access-tqsk7\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:47:35.530017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:35.529980    2563 generic.go:356] "Generic (PLEG): container finished" podID="0b7faf79-3578-41e5-b1aa-29599e521a52" containerID="f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0" exitCode=0
Jul 20 13:47:35.530466 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:35.530026    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dzj9p"
Jul 20 13:47:35.530466 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:35.530064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dzj9p" event={"ID":"0b7faf79-3578-41e5-b1aa-29599e521a52","Type":"ContainerDied","Data":"f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0"}
Jul 20 13:47:35.530466 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:35.530107    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dzj9p" event={"ID":"0b7faf79-3578-41e5-b1aa-29599e521a52","Type":"ContainerDied","Data":"f544f41d5392deb86b6b9297b2ddbbe1b3ef00b14d2f691f20511b96a6067175"}
Jul 20 13:47:35.530466 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:35.530127    2563 scope.go:117] "RemoveContainer" containerID="f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0"
Jul 20 13:47:35.538671 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:35.538654    2563 scope.go:117] "RemoveContainer" containerID="f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0"
Jul 20 13:47:35.538945 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:47:35.538928    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0\": container with ID starting with f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0 not found: ID does not exist" containerID="f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0"
Jul 20 13:47:35.538990 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:35.538953    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0"} err="failed to get container status \"f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0\": rpc error: code = NotFound desc = could not find container \"f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0\": container with ID starting with f55cfaec2ec176ea2d79e2a41f334009995a5487287ecc36cb4ed810f48ea9e0 not found: ID does not exist"
Jul 20 13:47:35.552756 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:35.552726    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dzj9p"]
Jul 20 13:47:35.561035 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:35.561006    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dzj9p"]
Jul 20 13:47:35.890465 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:35.890431    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-95b6bd676-nbq9n"]
Jul 20 13:47:36.535196 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:36.535161    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-95b6bd676-nbq9n" podUID="461fca2e-f582-4e70-9621-fa03eef1e07e" containerName="authorino" containerID="cri-o://0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17" gracePeriod=30
Jul 20 13:47:36.794191 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:36.794132    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-95b6bd676-nbq9n"
Jul 20 13:47:36.841582 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:36.841553    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfvcn\" (UniqueName: \"kubernetes.io/projected/461fca2e-f582-4e70-9621-fa03eef1e07e-kube-api-access-sfvcn\") pod \"461fca2e-f582-4e70-9621-fa03eef1e07e\" (UID: \"461fca2e-f582-4e70-9621-fa03eef1e07e\") "
Jul 20 13:47:36.843738 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:36.843710    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461fca2e-f582-4e70-9621-fa03eef1e07e-kube-api-access-sfvcn" (OuterVolumeSpecName: "kube-api-access-sfvcn") pod "461fca2e-f582-4e70-9621-fa03eef1e07e" (UID: "461fca2e-f582-4e70-9621-fa03eef1e07e"). InnerVolumeSpecName "kube-api-access-sfvcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:47:36.942255 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:36.942217    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfvcn\" (UniqueName: \"kubernetes.io/projected/461fca2e-f582-4e70-9621-fa03eef1e07e-kube-api-access-sfvcn\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 13:47:36.946180 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:36.946147    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b7faf79-3578-41e5-b1aa-29599e521a52" path="/var/lib/kubelet/pods/0b7faf79-3578-41e5-b1aa-29599e521a52/volumes"
Jul 20 13:47:37.541038 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:37.541006    2563 generic.go:356] "Generic (PLEG): container finished" podID="461fca2e-f582-4e70-9621-fa03eef1e07e" containerID="0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17" exitCode=0
Jul 20 13:47:37.541471 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:37.541055    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-95b6bd676-nbq9n"
Jul 20 13:47:37.541471 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:37.541083    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-95b6bd676-nbq9n" event={"ID":"461fca2e-f582-4e70-9621-fa03eef1e07e","Type":"ContainerDied","Data":"0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17"}
Jul 20 13:47:37.541471 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:37.541115    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-95b6bd676-nbq9n" event={"ID":"461fca2e-f582-4e70-9621-fa03eef1e07e","Type":"ContainerDied","Data":"08ec0aa35301b1deef641430b8a9b0a735d4c77e133afe2d7cfc356d3e82a96d"}
Jul 20 13:47:37.541471 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:37.541132    2563 scope.go:117] "RemoveContainer" containerID="0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17"
Jul 20 13:47:37.549787 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:37.549767    2563 scope.go:117] "RemoveContainer" containerID="0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17"
Jul 20 13:47:37.550035 ip-10-0-134-120 kubenswrapper[2563]: E0720 13:47:37.550014    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17\": container with ID starting with 0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17 not found: ID does not exist" containerID="0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17"
Jul 20 13:47:37.550079 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:37.550043    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17"} err="failed to get container status \"0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17\": rpc error: code = NotFound desc = could not find container \"0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17\": container with ID starting with 0c58dcf6d08385e5862f163890c3f56463869abae8800a00b0a1a88584659f17 not found: ID does not exist"
Jul 20 13:47:37.558091 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:37.558064    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-95b6bd676-nbq9n"]
Jul 20 13:47:37.564700 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:37.564678    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-95b6bd676-nbq9n"]
Jul 20 13:47:38.946092 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:47:38.946056    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="461fca2e-f582-4e70-9621-fa03eef1e07e" path="/var/lib/kubelet/pods/461fca2e-f582-4e70-9621-fa03eef1e07e/volumes"
Jul 20 13:48:13.631536 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:48:13.631499    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:48:31.451383 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:48:31.451345    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:48:59.245876 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:48:59.245791    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:49:08.951193 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:49:08.951157    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:49:17.044747 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:49:17.044708    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:49:33.750720 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:49:33.750684    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:49:45.950559 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:49:45.950520    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:50:48.648342 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.648261    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85d6c4b4cc-szbgv"]
Jul 20 13:50:48.648823 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.648656    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b7faf79-3578-41e5-b1aa-29599e521a52" containerName="authorino"
Jul 20 13:50:48.648823 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.648669    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b7faf79-3578-41e5-b1aa-29599e521a52" containerName="authorino"
Jul 20 13:50:48.648823 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.648679    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="461fca2e-f582-4e70-9621-fa03eef1e07e" containerName="authorino"
Jul 20 13:50:48.648823 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.648686    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="461fca2e-f582-4e70-9621-fa03eef1e07e" containerName="authorino"
Jul 20 13:50:48.648823 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.648743    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="461fca2e-f582-4e70-9621-fa03eef1e07e" containerName="authorino"
Jul 20 13:50:48.648823 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.648753    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b7faf79-3578-41e5-b1aa-29599e521a52" containerName="authorino"
Jul 20 13:50:48.651721 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.651707    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85d6c4b4cc-szbgv"
Jul 20 13:50:48.655544 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.655521    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-45rxl\""
Jul 20 13:50:48.655682 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.655582    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 20 13:50:48.661512 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.661489    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85d6c4b4cc-szbgv"]
Jul 20 13:50:48.721263 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.721219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa-tls-cert\") pod \"authorino-85d6c4b4cc-szbgv\" (UID: \"ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa\") " pod="kuadrant-system/authorino-85d6c4b4cc-szbgv"
Jul 20 13:50:48.721461 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.721302    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27xbg\" (UniqueName: \"kubernetes.io/projected/ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa-kube-api-access-27xbg\") pod \"authorino-85d6c4b4cc-szbgv\" (UID: \"ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa\") " pod="kuadrant-system/authorino-85d6c4b4cc-szbgv"
Jul 20 13:50:48.821982 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.821944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xbg\" (UniqueName: \"kubernetes.io/projected/ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa-kube-api-access-27xbg\") pod \"authorino-85d6c4b4cc-szbgv\" (UID: \"ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa\") " pod="kuadrant-system/authorino-85d6c4b4cc-szbgv"
Jul 20 13:50:48.822151 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.822008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa-tls-cert\") pod \"authorino-85d6c4b4cc-szbgv\" (UID: \"ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa\") " pod="kuadrant-system/authorino-85d6c4b4cc-szbgv"
Jul 20 13:50:48.824654 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.824626    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa-tls-cert\") pod \"authorino-85d6c4b4cc-szbgv\" (UID: \"ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa\") " pod="kuadrant-system/authorino-85d6c4b4cc-szbgv"
Jul 20 13:50:48.829330 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.829304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27xbg\" (UniqueName: \"kubernetes.io/projected/ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa-kube-api-access-27xbg\") pod \"authorino-85d6c4b4cc-szbgv\" (UID: \"ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa\") " pod="kuadrant-system/authorino-85d6c4b4cc-szbgv"
Jul 20 13:50:48.960589 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:48.960501    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85d6c4b4cc-szbgv"
Jul 20 13:50:49.096840 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:49.096816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85d6c4b4cc-szbgv"]
Jul 20 13:50:49.099016 ip-10-0-134-120 kubenswrapper[2563]: W0720 13:50:49.098990    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba5b3ad9_d324_4150_8c9d_b4adcf0aedfa.slice/crio-e0c2e3ee12e5775aba31ee702cd73b224e6c05a6e6f31a898737429e013c717c WatchSource:0}: Error finding container e0c2e3ee12e5775aba31ee702cd73b224e6c05a6e6f31a898737429e013c717c: Status 404 returned error can't find the container with id e0c2e3ee12e5775aba31ee702cd73b224e6c05a6e6f31a898737429e013c717c
Jul 20 13:50:49.100465 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:49.100448    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:50:49.428363 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:49.428330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85d6c4b4cc-szbgv" event={"ID":"ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa","Type":"ContainerStarted","Data":"e0c2e3ee12e5775aba31ee702cd73b224e6c05a6e6f31a898737429e013c717c"}
Jul 20 13:50:50.441273 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:50.441230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85d6c4b4cc-szbgv" event={"ID":"ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa","Type":"ContainerStarted","Data":"188682dd5c719518c5f2eebbc3b31d43da47b7e5ee2266de5da5f76fed69aa58"}
Jul 20 13:50:50.458219 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:50:50.458160    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85d6c4b4cc-szbgv" podStartSLOduration=1.8702536140000001 podStartE2EDuration="2.458143918s" totalImagesPullingTime="587.890304ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:50:50.45651847 +0000 UTC m=+742.004089862" watchObservedRunningTime="2026-07-20 13:50:50.458143918 +0000 UTC m=+742.005715282"
Jul 20 13:51:32.358683 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:51:32.358645    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:51:42.252097 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:51:42.252060    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:51:53.060017 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:51:53.059932    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:53:36.360809 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:53:36.360766    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:54:10.153848 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:54:10.153810    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:54:19.451514 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:54:19.451482    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:54:28.756061 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:54:28.756020    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:54:39.562672 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:54:39.562634    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:54:49.861877 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:54:49.861794    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:55:01.334152 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:55:01.334115    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:55:11.762374 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:55:11.762339    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:55:21.643098 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:55:21.643063    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:55:44.443380 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:55:44.443340    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:55:57.153738 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:55:57.153699    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:56:19.559792 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:56:19.559753    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:56:30.060998 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:56:30.060924    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:56:45.957645 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:56:45.957602    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:56:57.058011 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:56:57.057977    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:57:07.152732 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:57:07.152692    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:57:18.954675 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:57:18.954640    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:59:13.152034 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:59:13.151995    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:59:22.152214 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:59:22.152132    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:59:35.358594 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:59:35.358552    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:59:48.657812 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:59:48.657775    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 13:59:58.458208 ip-10-0-134-120 kubenswrapper[2563]: I0720 13:59:58.458169    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:00:09.154606 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:00:09.154569    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:00:17.253382 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:00:17.253349    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:00:28.690043 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:00:28.690006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:00:39.859612 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:00:39.859576    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:00:49.180692 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:00:49.180655    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:01:00.267296 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:01:00.267205    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:01:25.998479 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:01:25.998432    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:01:33.970286 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:01:33.970250    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:01:47.213229 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:01:47.213190    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:02:00.685973 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:02:00.685937    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:02:40.678517 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:02:40.678441    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:02:55.064750 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:02:55.064715    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:03:03.253302 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:03:03.253267    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:03:15.548754 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:03:15.548715    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:03:25.155918 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:03:25.155868    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:03:38.155674 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:03:38.155624    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:03:48.958366 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:03:48.958320    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:03:57.959530 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:03:57.959453    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:04:09.748489 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:04:09.748455    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:04:20.355502 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:04:20.355464    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:04:31.654016 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:04:31.653981    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:04:41.762471 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:04:41.762436    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:04:54.148523 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:04:54.148481    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:05:05.449244 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:05:05.449201    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:05:15.353035 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:05:15.352997    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:05:27.858884 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:05:27.858801    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:05:40.072223 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:05:40.072177    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:05:51.554260 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:05:51.554222    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:06:10.872100 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:06:10.872066    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:06:44.050583 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:06:44.050550    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:06:55.448814 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:06:55.448736    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:07:28.056853 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:07:28.056818    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:07:39.356728 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:07:39.356692    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:08:11.943863 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:08:11.943827    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:08:23.458117 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:08:23.458031    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:08:56.150260 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:08:56.150222    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:10:27.469839 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:10:27.469800    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:10:39.371887 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:10:39.371845    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:10:51.851699 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:10:51.851670    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:11:09.560527 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:11:09.560495    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:11:43.152702 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:11:43.152621    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:11:59.550768 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:11:59.550732    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:12:08.043065 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:08.043029    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk"]
Jul 20 14:12:08.046174 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:08.046157    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk"
Jul 20 14:12:08.048761 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:08.048740    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 14:12:08.048908 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:08.048785    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:12:08.055427 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:08.055378    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk"]
Jul 20 14:12:08.141775 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:08.141730    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/178a79c1-ace2-4a82-93e8-f6871e4f83de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-17600a65-9nvtk\" (UID: \"178a79c1-ace2-4a82-93e8-f6871e4f83de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk"
Jul 20 14:12:08.243047 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:08.243014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/178a79c1-ace2-4a82-93e8-f6871e4f83de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-17600a65-9nvtk\" (UID: \"178a79c1-ace2-4a82-93e8-f6871e4f83de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk"
Jul 20 14:12:08.243648 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:08.243629    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/178a79c1-ace2-4a82-93e8-f6871e4f83de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-17600a65-9nvtk\" (UID: \"178a79c1-ace2-4a82-93e8-f6871e4f83de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk"
Jul 20 14:12:08.357839 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:08.357807    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk"
Jul 20 14:12:08.491096 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:08.491070    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk"]
Jul 20 14:12:08.493146 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:12:08.493116    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178a79c1_ace2_4a82_93e8_f6871e4f83de.slice/crio-080e32d1bf8fd1b6df8e1b4aad57f9428df6418f924f8031741c18ab3e3c5fdc WatchSource:0}: Error finding container 080e32d1bf8fd1b6df8e1b4aad57f9428df6418f924f8031741c18ab3e3c5fdc: Status 404 returned error can't find the container with id 080e32d1bf8fd1b6df8e1b4aad57f9428df6418f924f8031741c18ab3e3c5fdc
Jul 20 14:12:08.495103 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:08.495085    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 14:12:09.404539 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:09.404505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk" event={"ID":"178a79c1-ace2-4a82-93e8-f6871e4f83de","Type":"ContainerStarted","Data":"080e32d1bf8fd1b6df8e1b4aad57f9428df6418f924f8031741c18ab3e3c5fdc"}
Jul 20 14:12:11.546997 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:11.546955    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:12:12.421275 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:12.421243    2563 generic.go:356] "Generic (PLEG): container finished" podID="178a79c1-ace2-4a82-93e8-f6871e4f83de" containerID="79cb36f51e58f4edaae3f72f5e7c1bb0ec72a57863463bfd0e824b486a0de403" exitCode=0
Jul 20 14:12:12.421442 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:12.421334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk" event={"ID":"178a79c1-ace2-4a82-93e8-f6871e4f83de","Type":"ContainerDied","Data":"79cb36f51e58f4edaae3f72f5e7c1bb0ec72a57863463bfd0e824b486a0de403"}
Jul 20 14:12:13.554103 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:13.554080    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk"
Jul 20 14:12:13.689786 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:13.689695    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/178a79c1-ace2-4a82-93e8-f6871e4f83de-maas-api-service-ca\") pod \"178a79c1-ace2-4a82-93e8-f6871e4f83de\" (UID: \"178a79c1-ace2-4a82-93e8-f6871e4f83de\") "
Jul 20 14:12:13.690117 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:13.690094    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/178a79c1-ace2-4a82-93e8-f6871e4f83de-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "178a79c1-ace2-4a82-93e8-f6871e4f83de" (UID: "178a79c1-ace2-4a82-93e8-f6871e4f83de"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:12:13.790455 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:13.790425    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/178a79c1-ace2-4a82-93e8-f6871e4f83de-maas-api-service-ca\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:12:14.431784 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:14.431754    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk"
Jul 20 14:12:14.431946 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:14.431800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk" event={"ID":"178a79c1-ace2-4a82-93e8-f6871e4f83de","Type":"ContainerDied","Data":"080e32d1bf8fd1b6df8e1b4aad57f9428df6418f924f8031741c18ab3e3c5fdc"}
Jul 20 14:12:14.431946 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:14.431845    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="080e32d1bf8fd1b6df8e1b4aad57f9428df6418f924f8031741c18ab3e3c5fdc"
Jul 20 14:12:21.740899 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:21.740856    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:12:28.121979 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:28.121945    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk"]
Jul 20 14:12:28.124441 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:28.124416    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17600a65-9nvtk"]
Jul 20 14:12:28.946747 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:28.946718    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="178a79c1-ace2-4a82-93e8-f6871e4f83de" path="/var/lib/kubelet/pods/178a79c1-ace2-4a82-93e8-f6871e4f83de/volumes"
Jul 20 14:12:33.251329 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:12:33.251287    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:13:22.229606 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:13:22.229568    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:13:32.352175 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:13:32.352136    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:14:24.158564 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:14:24.158479    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:14:40.150956 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:14:40.150924    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:14:55.157189 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:14:55.157142    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:15:00.133040 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.133004    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k"]
Jul 20 14:15:00.133562 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.133474    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="178a79c1-ace2-4a82-93e8-f6871e4f83de" containerName="revoke-keys"
Jul 20 14:15:00.133562 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.133493    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="178a79c1-ace2-4a82-93e8-f6871e4f83de" containerName="revoke-keys"
Jul 20 14:15:00.133684 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.133590    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="178a79c1-ace2-4a82-93e8-f6871e4f83de" containerName="revoke-keys"
Jul 20 14:15:00.136686 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.136664    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h"]
Jul 20 14:15:00.136828 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.136744    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k"
Jul 20 14:15:00.139174 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.139154    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:15:00.139602 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.139586    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742615-qgwjw"]
Jul 20 14:15:00.139721 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.139704    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h"
Jul 20 14:15:00.142675 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.142656    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742615-qgwjw"
Jul 20 14:15:00.143136 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.143102    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742615-qgwjw"]
Jul 20 14:15:00.147202 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.147175    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k"]
Jul 20 14:15:00.149779 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.149753    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h"]
Jul 20 14:15:00.150868 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.150850    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k"
Jul 20 14:15:00.160604 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.160570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h"
Jul 20 14:15:00.190498 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.190471    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742615-qgwjw"
Jul 20 14:15:00.332465 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.332277    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k"]
Jul 20 14:15:00.335844 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:15:00.335800    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85df7e4a_bf99_4b35_bbbb_bc349aa41d58.slice/crio-6e109ca19134d88d5e231fcf0839cbd6ef021716a9f01dc8cc603cbcf6f9dbc7 WatchSource:0}: Error finding container 6e109ca19134d88d5e231fcf0839cbd6ef021716a9f01dc8cc603cbcf6f9dbc7: Status 404 returned error can't find the container with id 6e109ca19134d88d5e231fcf0839cbd6ef021716a9f01dc8cc603cbcf6f9dbc7
Jul 20 14:15:00.378615 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.378591    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742615-qgwjw"]
Jul 20 14:15:00.380854 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:15:00.380828    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e078e68_4104_4cad_852a_6c9d7b4e9e0f.slice/crio-0770b8762d0f9820b48064c455753daf7bbf9d52a7a2e8b84cd9ab4d3536f7a8 WatchSource:0}: Error finding container 0770b8762d0f9820b48064c455753daf7bbf9d52a7a2e8b84cd9ab4d3536f7a8: Status 404 returned error can't find the container with id 0770b8762d0f9820b48064c455753daf7bbf9d52a7a2e8b84cd9ab4d3536f7a8
Jul 20 14:15:00.558229 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:00.558201    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h"]
Jul 20 14:15:00.559994 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:15:00.559967    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a979cc_c264_4fb0_a4fa_428d9c5b5173.slice/crio-a4af39046fae04357c43f01ca1444ea7a7b58b8eada0b6842ae1f251c49b0e5f WatchSource:0}: Error finding container a4af39046fae04357c43f01ca1444ea7a7b58b8eada0b6842ae1f251c49b0e5f: Status 404 returned error can't find the container with id a4af39046fae04357c43f01ca1444ea7a7b58b8eada0b6842ae1f251c49b0e5f
Jul 20 14:15:01.215972 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:01.215936    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h" event={"ID":"57a979cc-c264-4fb0-a4fa-428d9c5b5173","Type":"ContainerStarted","Data":"e5c7cb608ff909bf646d482183172f0c940f1751174ce7234bc7e1240cd2a16a"}
Jul 20 14:15:01.216391 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:01.215999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h" event={"ID":"57a979cc-c264-4fb0-a4fa-428d9c5b5173","Type":"ContainerStarted","Data":"a4af39046fae04357c43f01ca1444ea7a7b58b8eada0b6842ae1f251c49b0e5f"}
Jul 20 14:15:01.217527 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:01.217500    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742615-qgwjw" event={"ID":"4e078e68-4104-4cad-852a-6c9d7b4e9e0f","Type":"ContainerStarted","Data":"ed41b800f6e7b72b3c92318b5cbdd12e37fa92867dbdeb9f848ffae1c37e773e"}
Jul 20 14:15:01.217648 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:01.217549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742615-qgwjw" event={"ID":"4e078e68-4104-4cad-852a-6c9d7b4e9e0f","Type":"ContainerStarted","Data":"0770b8762d0f9820b48064c455753daf7bbf9d52a7a2e8b84cd9ab4d3536f7a8"}
Jul 20 14:15:01.218987 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:01.218965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k" event={"ID":"85df7e4a-bf99-4b35-bbbb-bc349aa41d58","Type":"ContainerStarted","Data":"23751c96b58e98f02d1157ff356607d8657174c2ef6226ffbac676ac18b84208"}
Jul 20 14:15:01.219094 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:01.219007    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k" event={"ID":"85df7e4a-bf99-4b35-bbbb-bc349aa41d58","Type":"ContainerStarted","Data":"6e109ca19134d88d5e231fcf0839cbd6ef021716a9f01dc8cc603cbcf6f9dbc7"}
Jul 20 14:15:01.232300 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:01.232251    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h" podStartSLOduration=1.232237681 podStartE2EDuration="1.232237681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:15:01.230770614 +0000 UTC m=+2192.778342000" watchObservedRunningTime="2026-07-20 14:15:01.232237681 +0000 UTC m=+2192.779809107"
Jul 20 14:15:01.247043 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:01.246994    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742615-qgwjw" podStartSLOduration=1.246980712 podStartE2EDuration="1.246980712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:15:01.245294998 +0000 UTC m=+2192.792866383" watchObservedRunningTime="2026-07-20 14:15:01.246980712 +0000 UTC m=+2192.794552096"
Jul 20 14:15:01.261065 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:01.261025    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k" podStartSLOduration=1.26101322 podStartE2EDuration="1.26101322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:15:01.259484732 +0000 UTC m=+2192.807056116" watchObservedRunningTime="2026-07-20 14:15:01.26101322 +0000 UTC m=+2192.808584655"
Jul 20 14:15:02.225444 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:02.225379    2563 generic.go:356] "Generic (PLEG): container finished" podID="57a979cc-c264-4fb0-a4fa-428d9c5b5173" containerID="e5c7cb608ff909bf646d482183172f0c940f1751174ce7234bc7e1240cd2a16a" exitCode=0
Jul 20 14:15:02.225902 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:02.225467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h" event={"ID":"57a979cc-c264-4fb0-a4fa-428d9c5b5173","Type":"ContainerDied","Data":"e5c7cb608ff909bf646d482183172f0c940f1751174ce7234bc7e1240cd2a16a"}
Jul 20 14:15:02.227020 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:02.226994    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e078e68-4104-4cad-852a-6c9d7b4e9e0f" containerID="ed41b800f6e7b72b3c92318b5cbdd12e37fa92867dbdeb9f848ffae1c37e773e" exitCode=0
Jul 20 14:15:02.227129 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:02.227067    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742615-qgwjw" event={"ID":"4e078e68-4104-4cad-852a-6c9d7b4e9e0f","Type":"ContainerDied","Data":"ed41b800f6e7b72b3c92318b5cbdd12e37fa92867dbdeb9f848ffae1c37e773e"}
Jul 20 14:15:02.228458 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:02.228439    2563 generic.go:356] "Generic (PLEG): container finished" podID="85df7e4a-bf99-4b35-bbbb-bc349aa41d58" containerID="23751c96b58e98f02d1157ff356607d8657174c2ef6226ffbac676ac18b84208" exitCode=0
Jul 20 14:15:02.228536 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:02.228510    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k" event={"ID":"85df7e4a-bf99-4b35-bbbb-bc349aa41d58","Type":"ContainerDied","Data":"23751c96b58e98f02d1157ff356607d8657174c2ef6226ffbac676ac18b84208"}
Jul 20 14:15:03.417803 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:03.417777    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742615-qgwjw"
Jul 20 14:15:03.420805 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:03.420783    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h"
Jul 20 14:15:03.424107 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:03.424090    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k"
Jul 20 14:15:04.239708 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:04.239674    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h"
Jul 20 14:15:04.239912 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:04.239670    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h" event={"ID":"57a979cc-c264-4fb0-a4fa-428d9c5b5173","Type":"ContainerDied","Data":"a4af39046fae04357c43f01ca1444ea7a7b58b8eada0b6842ae1f251c49b0e5f"}
Jul 20 14:15:04.239912 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:04.239816    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4af39046fae04357c43f01ca1444ea7a7b58b8eada0b6842ae1f251c49b0e5f"
Jul 20 14:15:04.240919 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:04.240884    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742615-qgwjw" event={"ID":"4e078e68-4104-4cad-852a-6c9d7b4e9e0f","Type":"ContainerDied","Data":"0770b8762d0f9820b48064c455753daf7bbf9d52a7a2e8b84cd9ab4d3536f7a8"}
Jul 20 14:15:04.240919 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:04.240913    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742615-qgwjw"
Jul 20 14:15:04.241103 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:04.240933    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0770b8762d0f9820b48064c455753daf7bbf9d52a7a2e8b84cd9ab4d3536f7a8"
Jul 20 14:15:04.242200 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:04.242182    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k" event={"ID":"85df7e4a-bf99-4b35-bbbb-bc349aa41d58","Type":"ContainerDied","Data":"6e109ca19134d88d5e231fcf0839cbd6ef021716a9f01dc8cc603cbcf6f9dbc7"}
Jul 20 14:15:04.242313 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:04.242219    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e109ca19134d88d5e231fcf0839cbd6ef021716a9f01dc8cc603cbcf6f9dbc7"
Jul 20 14:15:04.242313 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:04.242188    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k"
Jul 20 14:15:06.648648 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.648615    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"]
Jul 20 14:15:06.649109 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.649057    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57a979cc-c264-4fb0-a4fa-428d9c5b5173" containerName="cleanup"
Jul 20 14:15:06.649109 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.649074    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="57a979cc-c264-4fb0-a4fa-428d9c5b5173" containerName="cleanup"
Jul 20 14:15:06.649109 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.649086    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e078e68-4104-4cad-852a-6c9d7b4e9e0f" containerName="cleanup"
Jul 20 14:15:06.649109 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.649093    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e078e68-4104-4cad-852a-6c9d7b4e9e0f" containerName="cleanup"
Jul 20 14:15:06.649109 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.649105    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85df7e4a-bf99-4b35-bbbb-bc349aa41d58" containerName="cleanup"
Jul 20 14:15:06.649351 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.649113    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="85df7e4a-bf99-4b35-bbbb-bc349aa41d58" containerName="cleanup"
Jul 20 14:15:06.649351 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.649196    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="85df7e4a-bf99-4b35-bbbb-bc349aa41d58" containerName="cleanup"
Jul 20 14:15:06.649351 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.649207    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e078e68-4104-4cad-852a-6c9d7b4e9e0f" containerName="cleanup"
Jul 20 14:15:06.649351 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.649218    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="57a979cc-c264-4fb0-a4fa-428d9c5b5173" containerName="cleanup"
Jul 20 14:15:06.652544 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.652520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.656278 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.656252    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ea5ee7\"/\"kube-root-ca.crt\""
Jul 20 14:15:06.656467 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.656252    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ea5ee7\"/\"test-model-ea5ee7-kserve-self-signed-certs\""
Jul 20 14:15:06.656622 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.656323    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ea5ee7\"/\"default-dockercfg-gvnmp\""
Jul 20 14:15:06.656786 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.656333    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ea5ee7\"/\"openshift-service-ca.crt\""
Jul 20 14:15:06.663057 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.663014    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"]
Jul 20 14:15:06.685940 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.685906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-model-cache\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.686123 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.685971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb6x7\" (UniqueName: \"kubernetes.io/projected/faaaf9ec-598d-4424-8332-3ea7c3a6411b-kube-api-access-rb6x7\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.686123 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.686028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faaaf9ec-598d-4424-8332-3ea7c3a6411b-tls-certs\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.686123 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.686054    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-tmp-dir\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.686123 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.686091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-home\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.686123 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.686113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-dshm\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.787564 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.787523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faaaf9ec-598d-4424-8332-3ea7c3a6411b-tls-certs\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.787564 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.787565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-tmp-dir\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.787776 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.787693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-home\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.787776 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.787725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-dshm\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.787776 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.787756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-model-cache\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.787876 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.787825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb6x7\" (UniqueName: \"kubernetes.io/projected/faaaf9ec-598d-4424-8332-3ea7c3a6411b-kube-api-access-rb6x7\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.788044 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.788024    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-tmp-dir\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.788098 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.788071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-home\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.788206 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.788186    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-model-cache\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.790186 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.790161    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-dshm\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.790384 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.790369    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faaaf9ec-598d-4424-8332-3ea7c3a6411b-tls-certs\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.796952 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.796918    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb6x7\" (UniqueName: \"kubernetes.io/projected/faaaf9ec-598d-4424-8332-3ea7c3a6411b-kube-api-access-rb6x7\") pod \"test-model-ea5ee7-kserve-546cd45b57-k5qgw\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") " pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:06.963236 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:06.963124    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:07.104510 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:07.104479    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"]
Jul 20 14:15:07.106529 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:15:07.106503    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaaaf9ec_598d_4424_8332_3ea7c3a6411b.slice/crio-ed6bc0009b1749ea086f7cf7bc6f99651da7e005d033623a9e90d9ebb949a429 WatchSource:0}: Error finding container ed6bc0009b1749ea086f7cf7bc6f99651da7e005d033623a9e90d9ebb949a429: Status 404 returned error can't find the container with id ed6bc0009b1749ea086f7cf7bc6f99651da7e005d033623a9e90d9ebb949a429
Jul 20 14:15:07.257731 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:07.257648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw" event={"ID":"faaaf9ec-598d-4424-8332-3ea7c3a6411b","Type":"ContainerStarted","Data":"ed6bc0009b1749ea086f7cf7bc6f99651da7e005d033623a9e90d9ebb949a429"}
Jul 20 14:15:13.057156 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:13.057123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:15:14.304321 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:14.304277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw" event={"ID":"faaaf9ec-598d-4424-8332-3ea7c3a6411b","Type":"ContainerStarted","Data":"dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c"}
Jul 20 14:15:14.322354 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:14.322305    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw" podStartSLOduration=1.21105697 podStartE2EDuration="8.322287232s" totalImagesPullingTime="7.111230262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:15:14.321082454 +0000 UTC m=+2205.868653842" watchObservedRunningTime="2026-07-20 14:15:14.322287232 +0000 UTC m=+2205.869858620"
Jul 20 14:15:16.963740 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:16.963706    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:16.964117 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:16.963769    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:16.976371 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:16.976341    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:17.330316 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:17.330287    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:15:41.151877 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:15:41.151836    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:16:11.250744 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:11.250707    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:16:17.768425 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:17.768368    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"]
Jul 20 14:16:17.903394 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:17.903354    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf"]
Jul 20 14:16:17.906832 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:17.906816    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf"
Jul 20 14:16:17.909263 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:17.909243    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:16:17.909378 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:17.909288    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 14:16:17.914694 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:17.914213    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf"]
Jul 20 14:16:17.997857 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:17.997824    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/227709b2-47f7-45d8-83f2-40243d8f3845-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf\" (UID: \"227709b2-47f7-45d8-83f2-40243d8f3845\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf"
Jul 20 14:16:18.098789 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:18.098752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/227709b2-47f7-45d8-83f2-40243d8f3845-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf\" (UID: \"227709b2-47f7-45d8-83f2-40243d8f3845\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf"
Jul 20 14:16:18.099339 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:18.099313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/227709b2-47f7-45d8-83f2-40243d8f3845-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf\" (UID: \"227709b2-47f7-45d8-83f2-40243d8f3845\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf"
Jul 20 14:16:18.218990 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:18.218945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf"
Jul 20 14:16:18.353501 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:18.353477    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf"]
Jul 20 14:16:18.355299 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:16:18.355270    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod227709b2_47f7_45d8_83f2_40243d8f3845.slice/crio-b41e818e2d2d314aca2e301cb2f64f815383414dd2d54eb5ffd2b64a18ada86b WatchSource:0}: Error finding container b41e818e2d2d314aca2e301cb2f64f815383414dd2d54eb5ffd2b64a18ada86b: Status 404 returned error can't find the container with id b41e818e2d2d314aca2e301cb2f64f815383414dd2d54eb5ffd2b64a18ada86b
Jul 20 14:16:18.615128 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:18.615047    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf" event={"ID":"227709b2-47f7-45d8-83f2-40243d8f3845","Type":"ContainerStarted","Data":"b31012cd7a79f82b9c8ea0fe1a0ec79133c91f9827dc58bc152ea23dc1d693b2"}
Jul 20 14:16:18.615128 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:18.615098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf" event={"ID":"227709b2-47f7-45d8-83f2-40243d8f3845","Type":"ContainerStarted","Data":"b41e818e2d2d314aca2e301cb2f64f815383414dd2d54eb5ffd2b64a18ada86b"}
Jul 20 14:16:18.637203 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:18.632162    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf" podStartSLOduration=1.632140503 podStartE2EDuration="1.632140503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:16:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:16:18.630543257 +0000 UTC m=+2270.178114660" watchObservedRunningTime="2026-07-20 14:16:18.632140503 +0000 UTC m=+2270.179711895"
Jul 20 14:16:19.621745 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:19.621710    2563 generic.go:356] "Generic (PLEG): container finished" podID="227709b2-47f7-45d8-83f2-40243d8f3845" containerID="b31012cd7a79f82b9c8ea0fe1a0ec79133c91f9827dc58bc152ea23dc1d693b2" exitCode=0
Jul 20 14:16:19.622135 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:19.621806    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf" event={"ID":"227709b2-47f7-45d8-83f2-40243d8f3845","Type":"ContainerDied","Data":"b31012cd7a79f82b9c8ea0fe1a0ec79133c91f9827dc58bc152ea23dc1d693b2"}
Jul 20 14:16:20.754338 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:20.754314    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf"
Jul 20 14:16:20.826251 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:20.826221    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/227709b2-47f7-45d8-83f2-40243d8f3845-maas-api-service-ca\") pod \"227709b2-47f7-45d8-83f2-40243d8f3845\" (UID: \"227709b2-47f7-45d8-83f2-40243d8f3845\") "
Jul 20 14:16:20.826633 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:20.826611    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/227709b2-47f7-45d8-83f2-40243d8f3845-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "227709b2-47f7-45d8-83f2-40243d8f3845" (UID: "227709b2-47f7-45d8-83f2-40243d8f3845"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:16:20.927089 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:20.927007    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/227709b2-47f7-45d8-83f2-40243d8f3845-maas-api-service-ca\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:16:21.631969 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:21.631944    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf"
Jul 20 14:16:21.632206 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:21.631938    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf" event={"ID":"227709b2-47f7-45d8-83f2-40243d8f3845","Type":"ContainerDied","Data":"b41e818e2d2d314aca2e301cb2f64f815383414dd2d54eb5ffd2b64a18ada86b"}
Jul 20 14:16:21.632206 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:21.632066    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b41e818e2d2d314aca2e301cb2f64f815383414dd2d54eb5ffd2b64a18ada86b"
Jul 20 14:16:21.948983 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:21.948904    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:16:28.408900 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:28.408862    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k"]
Jul 20 14:16:28.413355 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:28.413325    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-13affc-29742615-2x97k"]
Jul 20 14:16:28.946350 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:28.946313    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85df7e4a-bf99-4b35-bbbb-bc349aa41d58" path="/var/lib/kubelet/pods/85df7e4a-bf99-4b35-bbbb-bc349aa41d58/volumes"
Jul 20 14:16:32.057968 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:32.057929    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:16:32.789370 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:32.789310    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw" podUID="faaaf9ec-598d-4424-8332-3ea7c3a6411b" containerName="main" containerID="cri-o://dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c" gracePeriod=45
Jul 20 14:16:32.998810 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:32.998779    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf"]
Jul 20 14:16:33.003774 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.003747    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-13affc-7w6hf"]
Jul 20 14:16:33.042564 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.042504    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:16:33.237686 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.237654    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faaaf9ec-598d-4424-8332-3ea7c3a6411b-tls-certs\") pod \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") "
Jul 20 14:16:33.238144 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.237692    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb6x7\" (UniqueName: \"kubernetes.io/projected/faaaf9ec-598d-4424-8332-3ea7c3a6411b-kube-api-access-rb6x7\") pod \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") "
Jul 20 14:16:33.238144 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.237729    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-tmp-dir\") pod \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") "
Jul 20 14:16:33.238144 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.237746    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-dshm\") pod \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") "
Jul 20 14:16:33.238144 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.237881    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-model-cache\") pod \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") "
Jul 20 14:16:33.238144 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.237994    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-home\") pod \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\" (UID: \"faaaf9ec-598d-4424-8332-3ea7c3a6411b\") "
Jul 20 14:16:33.238144 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.238039    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "faaaf9ec-598d-4424-8332-3ea7c3a6411b" (UID: "faaaf9ec-598d-4424-8332-3ea7c3a6411b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:33.238353 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.238154    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-model-cache" (OuterVolumeSpecName: "model-cache") pod "faaaf9ec-598d-4424-8332-3ea7c3a6411b" (UID: "faaaf9ec-598d-4424-8332-3ea7c3a6411b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:33.238353 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.238215    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-tmp-dir\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:16:33.238353 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.238229    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-model-cache\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:16:33.238353 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.238289    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-home" (OuterVolumeSpecName: "home") pod "faaaf9ec-598d-4424-8332-3ea7c3a6411b" (UID: "faaaf9ec-598d-4424-8332-3ea7c3a6411b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:33.240148 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.240116    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-dshm" (OuterVolumeSpecName: "dshm") pod "faaaf9ec-598d-4424-8332-3ea7c3a6411b" (UID: "faaaf9ec-598d-4424-8332-3ea7c3a6411b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:33.240262 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.240183    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faaaf9ec-598d-4424-8332-3ea7c3a6411b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "faaaf9ec-598d-4424-8332-3ea7c3a6411b" (UID: "faaaf9ec-598d-4424-8332-3ea7c3a6411b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:16:33.240262 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.240204    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faaaf9ec-598d-4424-8332-3ea7c3a6411b-kube-api-access-rb6x7" (OuterVolumeSpecName: "kube-api-access-rb6x7") pod "faaaf9ec-598d-4424-8332-3ea7c3a6411b" (UID: "faaaf9ec-598d-4424-8332-3ea7c3a6411b"). InnerVolumeSpecName "kube-api-access-rb6x7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:16:33.339174 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.339146    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-home\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:16:33.339174 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.339170    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faaaf9ec-598d-4424-8332-3ea7c3a6411b-tls-certs\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:16:33.339352 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.339186    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb6x7\" (UniqueName: \"kubernetes.io/projected/faaaf9ec-598d-4424-8332-3ea7c3a6411b-kube-api-access-rb6x7\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:16:33.339352 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.339197    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faaaf9ec-598d-4424-8332-3ea7c3a6411b-dshm\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:16:33.694526 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.694428    2563 generic.go:356] "Generic (PLEG): container finished" podID="faaaf9ec-598d-4424-8332-3ea7c3a6411b" containerID="dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c" exitCode=0
Jul 20 14:16:33.694526 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.694471    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"
Jul 20 14:16:33.694526 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.694475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw" event={"ID":"faaaf9ec-598d-4424-8332-3ea7c3a6411b","Type":"ContainerDied","Data":"dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c"}
Jul 20 14:16:33.694526 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.694514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw" event={"ID":"faaaf9ec-598d-4424-8332-3ea7c3a6411b","Type":"ContainerDied","Data":"ed6bc0009b1749ea086f7cf7bc6f99651da7e005d033623a9e90d9ebb949a429"}
Jul 20 14:16:33.694839 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.694532    2563 scope.go:117] "RemoveContainer" containerID="dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c"
Jul 20 14:16:33.703629 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.703611    2563 scope.go:117] "RemoveContainer" containerID="dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c"
Jul 20 14:16:33.703910 ip-10-0-134-120 kubenswrapper[2563]: E0720 14:16:33.703890    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c\": container with ID starting with dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c not found: ID does not exist" containerID="dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c"
Jul 20 14:16:33.703981 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.703925    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c"} err="failed to get container status \"dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c\": rpc error: code = NotFound desc = could not find container \"dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c\": container with ID starting with dc3b3bdfe7bff0492f03d6bf077b6b09bffb46d7f1fbd8ab883c3335d1153d1c not found: ID does not exist"
Jul 20 14:16:33.714974 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.714948    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"]
Jul 20 14:16:33.723421 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:33.723382    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ea5ee7/test-model-ea5ee7-kserve-546cd45b57-k5qgw"]
Jul 20 14:16:34.945174 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:34.945135    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="227709b2-47f7-45d8-83f2-40243d8f3845" path="/var/lib/kubelet/pods/227709b2-47f7-45d8-83f2-40243d8f3845/volumes"
Jul 20 14:16:34.945567 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:34.945521    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faaaf9ec-598d-4424-8332-3ea7c3a6411b" path="/var/lib/kubelet/pods/faaaf9ec-598d-4424-8332-3ea7c3a6411b/volumes"
Jul 20 14:16:40.119248 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.119215    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w"]
Jul 20 14:16:40.119657 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.119523    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="227709b2-47f7-45d8-83f2-40243d8f3845" containerName="revoke-keys"
Jul 20 14:16:40.119657 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.119534    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="227709b2-47f7-45d8-83f2-40243d8f3845" containerName="revoke-keys"
Jul 20 14:16:40.119657 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.119542    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faaaf9ec-598d-4424-8332-3ea7c3a6411b" containerName="main"
Jul 20 14:16:40.119657 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.119548    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="faaaf9ec-598d-4424-8332-3ea7c3a6411b" containerName="main"
Jul 20 14:16:40.119657 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.119598    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="faaaf9ec-598d-4424-8332-3ea7c3a6411b" containerName="main"
Jul 20 14:16:40.119657 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.119605    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="227709b2-47f7-45d8-83f2-40243d8f3845" containerName="revoke-keys"
Jul 20 14:16:40.123415 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.123385    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w"
Jul 20 14:16:40.126163 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.126144    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:16:40.126262 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.126147    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 14:16:40.130048 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.130016    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w"]
Jul 20 14:16:40.181482 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.181449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8149536e-f4ad-4095-bd5e-a096b2cf28e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w\" (UID: \"8149536e-f4ad-4095-bd5e-a096b2cf28e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w"
Jul 20 14:16:40.281913 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.281883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8149536e-f4ad-4095-bd5e-a096b2cf28e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w\" (UID: \"8149536e-f4ad-4095-bd5e-a096b2cf28e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w"
Jul 20 14:16:40.282525 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.282501    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8149536e-f4ad-4095-bd5e-a096b2cf28e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w\" (UID: \"8149536e-f4ad-4095-bd5e-a096b2cf28e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w"
Jul 20 14:16:40.435026 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.434944    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w"
Jul 20 14:16:40.571555 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.571527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w"]
Jul 20 14:16:40.573372 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:16:40.573340    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8149536e_f4ad_4095_bd5e_a096b2cf28e5.slice/crio-ea0d2fad94f56c582fc0d4fdea81fa19e79d1a5b2329c99b28f35d35a1da27f1 WatchSource:0}: Error finding container ea0d2fad94f56c582fc0d4fdea81fa19e79d1a5b2329c99b28f35d35a1da27f1: Status 404 returned error can't find the container with id ea0d2fad94f56c582fc0d4fdea81fa19e79d1a5b2329c99b28f35d35a1da27f1
Jul 20 14:16:40.731327 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:40.731241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w" event={"ID":"8149536e-f4ad-4095-bd5e-a096b2cf28e5","Type":"ContainerStarted","Data":"ea0d2fad94f56c582fc0d4fdea81fa19e79d1a5b2329c99b28f35d35a1da27f1"}
Jul 20 14:16:41.738488 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:41.738448    2563 generic.go:356] "Generic (PLEG): container finished" podID="8149536e-f4ad-4095-bd5e-a096b2cf28e5" containerID="067346528cba29a0d828c360d055bfa35cd88c2034e0ba87886eb3e3c2bcad8d" exitCode=0
Jul 20 14:16:41.738930 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:41.738544    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w" event={"ID":"8149536e-f4ad-4095-bd5e-a096b2cf28e5","Type":"ContainerDied","Data":"067346528cba29a0d828c360d055bfa35cd88c2034e0ba87886eb3e3c2bcad8d"}
Jul 20 14:16:42.871699 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:42.871677    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w"
Jul 20 14:16:42.901810 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:42.901782    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8149536e-f4ad-4095-bd5e-a096b2cf28e5-maas-api-service-ca\") pod \"8149536e-f4ad-4095-bd5e-a096b2cf28e5\" (UID: \"8149536e-f4ad-4095-bd5e-a096b2cf28e5\") "
Jul 20 14:16:42.902115 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:42.902090    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8149536e-f4ad-4095-bd5e-a096b2cf28e5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8149536e-f4ad-4095-bd5e-a096b2cf28e5" (UID: "8149536e-f4ad-4095-bd5e-a096b2cf28e5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:16:43.002908 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:43.002815    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8149536e-f4ad-4095-bd5e-a096b2cf28e5-maas-api-service-ca\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:16:43.748829 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:43.748798    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w"
Jul 20 14:16:43.748829 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:43.748826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w" event={"ID":"8149536e-f4ad-4095-bd5e-a096b2cf28e5","Type":"ContainerDied","Data":"ea0d2fad94f56c582fc0d4fdea81fa19e79d1a5b2329c99b28f35d35a1da27f1"}
Jul 20 14:16:43.749040 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:43.748873    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea0d2fad94f56c582fc0d4fdea81fa19e79d1a5b2329c99b28f35d35a1da27f1"
Jul 20 14:16:50.721439 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:50.721348    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h"]
Jul 20 14:16:50.732422 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:50.732376    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ea5ee7-29742615-rlr9h"]
Jul 20 14:16:50.945452 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:50.945397    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57a979cc-c264-4fb0-a4fa-428d9c5b5173" path="/var/lib/kubelet/pods/57a979cc-c264-4fb0-a4fa-428d9c5b5173/volumes"
Jul 20 14:16:53.554250 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:53.554214    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:16:55.198620 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:55.198581    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w"]
Jul 20 14:16:55.203544 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:55.203515    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea5ee7-z8t5w"]
Jul 20 14:16:56.945976 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:16:56.945942    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8149536e-f4ad-4095-bd5e-a096b2cf28e5" path="/var/lib/kubelet/pods/8149536e-f4ad-4095-bd5e-a096b2cf28e5/volumes"
Jul 20 14:17:13.465713 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:13.465672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:17:27.255868 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.255794    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h"]
Jul 20 14:17:27.256302 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.256080    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8149536e-f4ad-4095-bd5e-a096b2cf28e5" containerName="revoke-keys"
Jul 20 14:17:27.256302 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.256089    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8149536e-f4ad-4095-bd5e-a096b2cf28e5" containerName="revoke-keys"
Jul 20 14:17:27.256302 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.256147    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8149536e-f4ad-4095-bd5e-a096b2cf28e5" containerName="revoke-keys"
Jul 20 14:17:27.259235 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.259217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h"
Jul 20 14:17:27.261739 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.261721    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 14:17:27.261845 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.261826    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:17:27.266392 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.266364    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h"]
Jul 20 14:17:27.373121 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.373066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4788f2e7-a8a1-4fe1-8d80-444a89e01439-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h\" (UID: \"4788f2e7-a8a1-4fe1-8d80-444a89e01439\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h"
Jul 20 14:17:27.474325 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.474296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4788f2e7-a8a1-4fe1-8d80-444a89e01439-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h\" (UID: \"4788f2e7-a8a1-4fe1-8d80-444a89e01439\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h"
Jul 20 14:17:27.474885 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.474867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4788f2e7-a8a1-4fe1-8d80-444a89e01439-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h\" (UID: \"4788f2e7-a8a1-4fe1-8d80-444a89e01439\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h"
Jul 20 14:17:27.571275 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.571250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h"
Jul 20 14:17:27.702908 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.702877    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h"]
Jul 20 14:17:27.705125 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:17:27.705100    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4788f2e7_a8a1_4fe1_8d80_444a89e01439.slice/crio-be2d0978474dbfee3e4fc8fcd64a881fd77f682e5c526278fff7d361c7d4e1e6 WatchSource:0}: Error finding container be2d0978474dbfee3e4fc8fcd64a881fd77f682e5c526278fff7d361c7d4e1e6: Status 404 returned error can't find the container with id be2d0978474dbfee3e4fc8fcd64a881fd77f682e5c526278fff7d361c7d4e1e6
Jul 20 14:17:27.960315 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:27.960277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h" event={"ID":"4788f2e7-a8a1-4fe1-8d80-444a89e01439","Type":"ContainerStarted","Data":"be2d0978474dbfee3e4fc8fcd64a881fd77f682e5c526278fff7d361c7d4e1e6"}
Jul 20 14:17:28.967146 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:28.967110    2563 generic.go:356] "Generic (PLEG): container finished" podID="4788f2e7-a8a1-4fe1-8d80-444a89e01439" containerID="bde4045718e8ebda9aed97408cf15173c035a4ebc0f70cbc96beb140ac235d1c" exitCode=0
Jul 20 14:17:28.967554 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:28.967197    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h" event={"ID":"4788f2e7-a8a1-4fe1-8d80-444a89e01439","Type":"ContainerDied","Data":"bde4045718e8ebda9aed97408cf15173c035a4ebc0f70cbc96beb140ac235d1c"}
Jul 20 14:17:30.101286 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:30.101263    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h"
Jul 20 14:17:30.197037 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:30.197005    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4788f2e7-a8a1-4fe1-8d80-444a89e01439-maas-api-service-ca\") pod \"4788f2e7-a8a1-4fe1-8d80-444a89e01439\" (UID: \"4788f2e7-a8a1-4fe1-8d80-444a89e01439\") "
Jul 20 14:17:30.197334 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:30.197309    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4788f2e7-a8a1-4fe1-8d80-444a89e01439-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4788f2e7-a8a1-4fe1-8d80-444a89e01439" (UID: "4788f2e7-a8a1-4fe1-8d80-444a89e01439"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:17:30.298021 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:30.297949    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4788f2e7-a8a1-4fe1-8d80-444a89e01439-maas-api-service-ca\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:17:30.977663 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:30.977627    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h" event={"ID":"4788f2e7-a8a1-4fe1-8d80-444a89e01439","Type":"ContainerDied","Data":"be2d0978474dbfee3e4fc8fcd64a881fd77f682e5c526278fff7d361c7d4e1e6"}
Jul 20 14:17:30.977663 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:30.977657    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h"
Jul 20 14:17:30.977848 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:30.977679    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be2d0978474dbfee3e4fc8fcd64a881fd77f682e5c526278fff7d361c7d4e1e6"
Jul 20 14:17:31.959396 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:31.959358    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:17:47.341885 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:47.341851    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h"]
Jul 20 14:17:47.344265 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:47.344237    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e9d90e-tvg6h"]
Jul 20 14:17:48.755481 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:48.755449    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:17:48.945341 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:48.945308    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4788f2e7-a8a1-4fe1-8d80-444a89e01439" path="/var/lib/kubelet/pods/4788f2e7-a8a1-4fe1-8d80-444a89e01439/volumes"
Jul 20 14:17:54.867957 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:54.867916    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r"]
Jul 20 14:17:54.868446 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:54.868359    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4788f2e7-a8a1-4fe1-8d80-444a89e01439" containerName="revoke-keys"
Jul 20 14:17:54.868446 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:54.868376    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4788f2e7-a8a1-4fe1-8d80-444a89e01439" containerName="revoke-keys"
Jul 20 14:17:54.868578 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:54.868478    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4788f2e7-a8a1-4fe1-8d80-444a89e01439" containerName="revoke-keys"
Jul 20 14:17:54.871676 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:54.871654    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r"
Jul 20 14:17:54.874162 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:54.874138    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 14:17:54.874420 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:54.874381    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:17:54.878199 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:54.878171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r"]
Jul 20 14:17:54.990303 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:54.990268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7343c024-ee3d-4b15-8ee9-9781454d6afe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r\" (UID: \"7343c024-ee3d-4b15-8ee9-9781454d6afe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r"
Jul 20 14:17:55.091845 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:55.091807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7343c024-ee3d-4b15-8ee9-9781454d6afe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r\" (UID: \"7343c024-ee3d-4b15-8ee9-9781454d6afe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r"
Jul 20 14:17:55.092439 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:55.092395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7343c024-ee3d-4b15-8ee9-9781454d6afe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r\" (UID: \"7343c024-ee3d-4b15-8ee9-9781454d6afe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r"
Jul 20 14:17:55.183295 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:55.183210    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r"
Jul 20 14:17:55.315574 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:55.315383    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r"]
Jul 20 14:17:55.318183 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:17:55.318156    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7343c024_ee3d_4b15_8ee9_9781454d6afe.slice/crio-1387b4c5a8fae60eefd388595a461adc0733dc71657d7dc668efb2ed054c85d2 WatchSource:0}: Error finding container 1387b4c5a8fae60eefd388595a461adc0733dc71657d7dc668efb2ed054c85d2: Status 404 returned error can't find the container with id 1387b4c5a8fae60eefd388595a461adc0733dc71657d7dc668efb2ed054c85d2
Jul 20 14:17:56.103477 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:56.103442    2563 generic.go:356] "Generic (PLEG): container finished" podID="7343c024-ee3d-4b15-8ee9-9781454d6afe" containerID="8a2e8df2491e2068fbc099806b694e71379c375c28b25d65347c2aa0b0faf64f" exitCode=0
Jul 20 14:17:56.103876 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:56.103536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r" event={"ID":"7343c024-ee3d-4b15-8ee9-9781454d6afe","Type":"ContainerDied","Data":"8a2e8df2491e2068fbc099806b694e71379c375c28b25d65347c2aa0b0faf64f"}
Jul 20 14:17:56.103876 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:56.103594    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r" event={"ID":"7343c024-ee3d-4b15-8ee9-9781454d6afe","Type":"ContainerStarted","Data":"1387b4c5a8fae60eefd388595a461adc0733dc71657d7dc668efb2ed054c85d2"}
Jul 20 14:17:57.241188 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:57.241167    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r"
Jul 20 14:17:57.311792 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:57.311763    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7343c024-ee3d-4b15-8ee9-9781454d6afe-maas-api-service-ca\") pod \"7343c024-ee3d-4b15-8ee9-9781454d6afe\" (UID: \"7343c024-ee3d-4b15-8ee9-9781454d6afe\") "
Jul 20 14:17:57.312108 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:57.312087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7343c024-ee3d-4b15-8ee9-9781454d6afe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7343c024-ee3d-4b15-8ee9-9781454d6afe" (UID: "7343c024-ee3d-4b15-8ee9-9781454d6afe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:17:57.412841 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:57.412752    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7343c024-ee3d-4b15-8ee9-9781454d6afe-maas-api-service-ca\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:17:58.119735 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:58.119704    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r"
Jul 20 14:17:58.119921 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:58.119735    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r" event={"ID":"7343c024-ee3d-4b15-8ee9-9781454d6afe","Type":"ContainerDied","Data":"1387b4c5a8fae60eefd388595a461adc0733dc71657d7dc668efb2ed054c85d2"}
Jul 20 14:17:58.119921 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:17:58.119814    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1387b4c5a8fae60eefd388595a461adc0733dc71657d7dc668efb2ed054c85d2"
Jul 20 14:18:14.945338 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:14.945309    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r"]
Jul 20 14:18:14.948555 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:14.948530    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2c40e1-xhq9r"]
Jul 20 14:18:15.875650 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:15.875613    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:18:16.945364 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:16.945331    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7343c024-ee3d-4b15-8ee9-9781454d6afe" path="/var/lib/kubelet/pods/7343c024-ee3d-4b15-8ee9-9781454d6afe/volumes"
Jul 20 14:18:29.091247 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:29.091209    2563 scope.go:117] "RemoveContainer" containerID="79cb36f51e58f4edaae3f72f5e7c1bb0ec72a57863463bfd0e824b486a0de403"
Jul 20 14:18:31.352692 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:31.352647    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:18:48.106064 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:48.106025    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:18:56.058502 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.058467    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"]
Jul 20 14:18:56.058898 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.058762    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7343c024-ee3d-4b15-8ee9-9781454d6afe" containerName="revoke-keys"
Jul 20 14:18:56.058898 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.058773    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7343c024-ee3d-4b15-8ee9-9781454d6afe" containerName="revoke-keys"
Jul 20 14:18:56.058898 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.058832    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7343c024-ee3d-4b15-8ee9-9781454d6afe" containerName="revoke-keys"
Jul 20 14:18:56.062829 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.062810    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.066620 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.066595    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-57d0e8\"/\"kube-root-ca.crt\""
Jul 20 14:18:56.066620 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.066608    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-57d0e8\"/\"auth-test-model-57d0e8-kserve-self-signed-certs\""
Jul 20 14:18:56.066821 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.066607    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-57d0e8\"/\"default-dockercfg-5lpjq\""
Jul 20 14:18:56.066821 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.066660    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-57d0e8\"/\"openshift-service-ca.crt\""
Jul 20 14:18:56.075114 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.075065    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"]
Jul 20 14:18:56.088021 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.087990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-tls-certs\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.088219 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.088025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-home\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.088219 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.088055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-dshm\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.088219 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.088119    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-model-cache\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.088219 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.088184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-tmp-dir\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.088390 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.088230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhlwf\" (UniqueName: \"kubernetes.io/projected/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-kube-api-access-fhlwf\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.188784 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.188744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-tls-certs\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.188784 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.188782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-home\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.189039 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.188818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-dshm\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.189039 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.188858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-model-cache\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.189039 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.188894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-tmp-dir\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.189039 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.188932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhlwf\" (UniqueName: \"kubernetes.io/projected/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-kube-api-access-fhlwf\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.189262 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.189241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-home\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.189327 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.189301    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-model-cache\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.189382 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.189352    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-tmp-dir\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.191187 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.191169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-dshm\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.191549 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.191532    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-tls-certs\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.198197 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.198173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhlwf\" (UniqueName: \"kubernetes.io/projected/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-kube-api-access-fhlwf\") pod \"auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") " pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.373234 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.373194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:18:56.518361 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:56.518334    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"]
Jul 20 14:18:56.520325 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:18:56.520268    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb4e5cee_cf50_4559_b1e5_029bde9baf1b.slice/crio-eda80b8ec43bd41c6a8045f3335317a2396e7db6bd01dfd6074103cc36b5a46b WatchSource:0}: Error finding container eda80b8ec43bd41c6a8045f3335317a2396e7db6bd01dfd6074103cc36b5a46b: Status 404 returned error can't find the container with id eda80b8ec43bd41c6a8045f3335317a2396e7db6bd01dfd6074103cc36b5a46b
Jul 20 14:18:57.426076 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:57.426036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv" event={"ID":"fb4e5cee-cf50-4559-b1e5-029bde9baf1b","Type":"ContainerStarted","Data":"42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95"}
Jul 20 14:18:57.426076 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:57.426082    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv" event={"ID":"fb4e5cee-cf50-4559-b1e5-029bde9baf1b","Type":"ContainerStarted","Data":"eda80b8ec43bd41c6a8045f3335317a2396e7db6bd01dfd6074103cc36b5a46b"}
Jul 20 14:18:57.443352 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:18:57.443300    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv" podStartSLOduration=1.4432849700000001 podStartE2EDuration="1.44328497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:18:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:18:57.441993994 +0000 UTC m=+2428.989565380" watchObservedRunningTime="2026-07-20 14:18:57.44328497 +0000 UTC m=+2428.990856355"
Jul 20 14:19:02.158733 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:02.158692    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:19:06.374008 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:06.373955    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:19:06.374453 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:06.374044    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:19:06.386940 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:06.386915    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:19:06.482808 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:06.482782    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:19:31.167643 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.167608    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"]
Jul 20 14:19:31.171688 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.171662    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.176492 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.176277    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-424aa6\"/\"default-dockercfg-mz252\""
Jul 20 14:19:31.176492 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.176287    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-424aa6\"/\"kube-root-ca.crt\""
Jul 20 14:19:31.176724 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.176569    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-424aa6\"/\"openshift-service-ca.crt\""
Jul 20 14:19:31.176871 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.176849    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-424aa6\"/\"auth-test-model-424aa6-kserve-self-signed-certs\""
Jul 20 14:19:31.179884 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.179860    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"]
Jul 20 14:19:31.287266 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.287227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxcg6\" (UniqueName: \"kubernetes.io/projected/eb8a83f3-74e2-48e5-886f-228b74dad708-kube-api-access-sxcg6\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.287462 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.287303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-tmp-dir\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.287462 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.287336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-dshm\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.287462 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.287361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-model-cache\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.287462 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.287421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-home\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.287605 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.287494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8a83f3-74e2-48e5-886f-228b74dad708-tls-certs\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.388086 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.388049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8a83f3-74e2-48e5-886f-228b74dad708-tls-certs\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.388280 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.388094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxcg6\" (UniqueName: \"kubernetes.io/projected/eb8a83f3-74e2-48e5-886f-228b74dad708-kube-api-access-sxcg6\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.388280 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.388131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-tmp-dir\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.388280 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.388164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-dshm\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.388280 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.388187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-model-cache\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.388280 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.388203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-home\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.388720 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.388687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-home\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.388829 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.388727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-tmp-dir\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.388829 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.388817    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-model-cache\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.390621 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.390606    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-dshm\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.390792 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.390775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8a83f3-74e2-48e5-886f-228b74dad708-tls-certs\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.396428 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.396386    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxcg6\" (UniqueName: \"kubernetes.io/projected/eb8a83f3-74e2-48e5-886f-228b74dad708-kube-api-access-sxcg6\") pod \"auth-test-model-424aa6-kserve-7bd66b779f-wz5m8\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") " pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.485458 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.485360    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:31.642265 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:31.642241    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"]
Jul 20 14:19:31.644332 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:19:31.644292    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb8a83f3_74e2_48e5_886f_228b74dad708.slice/crio-0151ad640d8ebd79f355736b1a6c4a100ce72129f51d479da57b598553e8ce24 WatchSource:0}: Error finding container 0151ad640d8ebd79f355736b1a6c4a100ce72129f51d479da57b598553e8ce24: Status 404 returned error can't find the container with id 0151ad640d8ebd79f355736b1a6c4a100ce72129f51d479da57b598553e8ce24
Jul 20 14:19:32.608127 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:32.608090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8" event={"ID":"eb8a83f3-74e2-48e5-886f-228b74dad708","Type":"ContainerStarted","Data":"c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31"}
Jul 20 14:19:32.608127 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:32.608135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8" event={"ID":"eb8a83f3-74e2-48e5-886f-228b74dad708","Type":"ContainerStarted","Data":"0151ad640d8ebd79f355736b1a6c4a100ce72129f51d479da57b598553e8ce24"}
Jul 20 14:19:32.626033 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:32.625980    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8" podStartSLOduration=1.625964655 podStartE2EDuration="1.625964655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:19:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:19:32.623868879 +0000 UTC m=+2464.171440263" watchObservedRunningTime="2026-07-20 14:19:32.625964655 +0000 UTC m=+2464.173536041"
Jul 20 14:19:35.249368 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:35.249329    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:19:41.486092 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:41.486050    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:41.486626 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:41.486113    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:41.498745 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:41.498719    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:41.667099 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:41.667070    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:19:53.546657 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:19:53.546622    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:20:11.755277 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:20:11.755241    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:20:27.654147 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:20:27.654061    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:20:43.963419 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:20:43.963363    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:21:02.247103 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:21:02.247066    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:21:20.759509 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:21:20.759473    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:21:29.126541 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:21:29.126509    2563 scope.go:117] "RemoveContainer" containerID="e5c7cb608ff909bf646d482183172f0c940f1751174ce7234bc7e1240cd2a16a"
Jul 20 14:21:29.134914 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:21:29.134891    2563 scope.go:117] "RemoveContainer" containerID="23751c96b58e98f02d1157ff356607d8657174c2ef6226ffbac676ac18b84208"
Jul 20 14:21:40.750698 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:21:40.750659    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:21:53.418434 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:21:53.418347    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"]
Jul 20 14:21:54.375013 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:21:54.374977    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"]
Jul 20 14:21:57.058224 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:21:57.058181    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:22:08.438617 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.438558    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv" podUID="fb4e5cee-cf50-4559-b1e5-029bde9baf1b" containerName="main" containerID="cri-o://42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95" gracePeriod=45
Jul 20 14:22:08.688614 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.688579    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:22:08.809383 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.809292    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-home\") pod \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") "
Jul 20 14:22:08.809383 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.809345    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-tmp-dir\") pod \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") "
Jul 20 14:22:08.809383 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.809369    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhlwf\" (UniqueName: \"kubernetes.io/projected/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-kube-api-access-fhlwf\") pod \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") "
Jul 20 14:22:08.809699 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.809396    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-dshm\") pod \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") "
Jul 20 14:22:08.809699 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.809459    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-tls-certs\") pod \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") "
Jul 20 14:22:08.809699 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.809501    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-model-cache\") pod \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\" (UID: \"fb4e5cee-cf50-4559-b1e5-029bde9baf1b\") "
Jul 20 14:22:08.809699 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.809652    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-home" (OuterVolumeSpecName: "home") pod "fb4e5cee-cf50-4559-b1e5-029bde9baf1b" (UID: "fb4e5cee-cf50-4559-b1e5-029bde9baf1b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:22:08.809699 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.809666    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb4e5cee-cf50-4559-b1e5-029bde9baf1b" (UID: "fb4e5cee-cf50-4559-b1e5-029bde9baf1b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:22:08.809899 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.809840    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb4e5cee-cf50-4559-b1e5-029bde9baf1b" (UID: "fb4e5cee-cf50-4559-b1e5-029bde9baf1b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:22:08.811798 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.811774    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-dshm" (OuterVolumeSpecName: "dshm") pod "fb4e5cee-cf50-4559-b1e5-029bde9baf1b" (UID: "fb4e5cee-cf50-4559-b1e5-029bde9baf1b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:22:08.811911 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.811794    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb4e5cee-cf50-4559-b1e5-029bde9baf1b" (UID: "fb4e5cee-cf50-4559-b1e5-029bde9baf1b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:22:08.811911 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.811845    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-kube-api-access-fhlwf" (OuterVolumeSpecName: "kube-api-access-fhlwf") pod "fb4e5cee-cf50-4559-b1e5-029bde9baf1b" (UID: "fb4e5cee-cf50-4559-b1e5-029bde9baf1b"). InnerVolumeSpecName "kube-api-access-fhlwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:22:08.910624 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.910585    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-tls-certs\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:22:08.910624 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.910617    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-model-cache\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:22:08.910624 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.910626    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-home\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:22:08.910624 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.910634    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-tmp-dir\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:22:08.910904 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.910643    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhlwf\" (UniqueName: \"kubernetes.io/projected/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-kube-api-access-fhlwf\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:22:08.910904 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:08.910652    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb4e5cee-cf50-4559-b1e5-029bde9baf1b-dshm\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:22:09.395295 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.395236    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8" podUID="eb8a83f3-74e2-48e5-886f-228b74dad708" containerName="main" containerID="cri-o://c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31" gracePeriod=45
Jul 20 14:22:09.403923 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.403895    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb4e5cee-cf50-4559-b1e5-029bde9baf1b" containerID="42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95" exitCode=0
Jul 20 14:22:09.404060 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.403936    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"
Jul 20 14:22:09.404060 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.403935    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv" event={"ID":"fb4e5cee-cf50-4559-b1e5-029bde9baf1b","Type":"ContainerDied","Data":"42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95"}
Jul 20 14:22:09.404133 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.404071    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv" event={"ID":"fb4e5cee-cf50-4559-b1e5-029bde9baf1b","Type":"ContainerDied","Data":"eda80b8ec43bd41c6a8045f3335317a2396e7db6bd01dfd6074103cc36b5a46b"}
Jul 20 14:22:09.404133 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.404107    2563 scope.go:117] "RemoveContainer" containerID="42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95"
Jul 20 14:22:09.455015 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.454985    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"]
Jul 20 14:22:09.458604 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.458574    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/auth-test-model-57d0e8-kserve-57f74f9cbc-r8tpv"]
Jul 20 14:22:09.506599 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.506465    2563 scope.go:117] "RemoveContainer" containerID="42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95"
Jul 20 14:22:09.506854 ip-10-0-134-120 kubenswrapper[2563]: E0720 14:22:09.506826    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95\": container with ID starting with 42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95 not found: ID does not exist" containerID="42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95"
Jul 20 14:22:09.506917 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.506865    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95"} err="failed to get container status \"42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95\": rpc error: code = NotFound desc = could not find container \"42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95\": container with ID starting with 42230c5995d8500a7138503272b5686e32e41fe4abb6c42b3f9ff7831f792f95 not found: ID does not exist"
Jul 20 14:22:09.650013 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.649939    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:22:09.716559 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.716530    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-tmp-dir\") pod \"eb8a83f3-74e2-48e5-886f-228b74dad708\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") "
Jul 20 14:22:09.716757 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.716589    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-model-cache\") pod \"eb8a83f3-74e2-48e5-886f-228b74dad708\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") "
Jul 20 14:22:09.716757 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.716619    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-dshm\") pod \"eb8a83f3-74e2-48e5-886f-228b74dad708\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") "
Jul 20 14:22:09.716757 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.716674    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxcg6\" (UniqueName: \"kubernetes.io/projected/eb8a83f3-74e2-48e5-886f-228b74dad708-kube-api-access-sxcg6\") pod \"eb8a83f3-74e2-48e5-886f-228b74dad708\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") "
Jul 20 14:22:09.716757 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.716691    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-home\") pod \"eb8a83f3-74e2-48e5-886f-228b74dad708\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") "
Jul 20 14:22:09.716757 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.716712    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8a83f3-74e2-48e5-886f-228b74dad708-tls-certs\") pod \"eb8a83f3-74e2-48e5-886f-228b74dad708\" (UID: \"eb8a83f3-74e2-48e5-886f-228b74dad708\") "
Jul 20 14:22:09.717020 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.716873    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eb8a83f3-74e2-48e5-886f-228b74dad708" (UID: "eb8a83f3-74e2-48e5-886f-228b74dad708"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:22:09.717020 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.716879    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-model-cache" (OuterVolumeSpecName: "model-cache") pod "eb8a83f3-74e2-48e5-886f-228b74dad708" (UID: "eb8a83f3-74e2-48e5-886f-228b74dad708"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:22:09.717020 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.716969    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-home" (OuterVolumeSpecName: "home") pod "eb8a83f3-74e2-48e5-886f-228b74dad708" (UID: "eb8a83f3-74e2-48e5-886f-228b74dad708"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:22:09.719069 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.719038    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-dshm" (OuterVolumeSpecName: "dshm") pod "eb8a83f3-74e2-48e5-886f-228b74dad708" (UID: "eb8a83f3-74e2-48e5-886f-228b74dad708"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:22:09.719069 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.719038    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8a83f3-74e2-48e5-886f-228b74dad708-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eb8a83f3-74e2-48e5-886f-228b74dad708" (UID: "eb8a83f3-74e2-48e5-886f-228b74dad708"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:22:09.719221 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.719130    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb8a83f3-74e2-48e5-886f-228b74dad708-kube-api-access-sxcg6" (OuterVolumeSpecName: "kube-api-access-sxcg6") pod "eb8a83f3-74e2-48e5-886f-228b74dad708" (UID: "eb8a83f3-74e2-48e5-886f-228b74dad708"). InnerVolumeSpecName "kube-api-access-sxcg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:22:09.818172 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.818130    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-model-cache\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:22:09.818172 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.818162    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-dshm\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:22:09.818172 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.818172    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxcg6\" (UniqueName: \"kubernetes.io/projected/eb8a83f3-74e2-48e5-886f-228b74dad708-kube-api-access-sxcg6\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:22:09.818172 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.818181    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-home\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:22:09.818496 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.818188    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8a83f3-74e2-48e5-886f-228b74dad708-tls-certs\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:22:09.818496 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:09.818197    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb8a83f3-74e2-48e5-886f-228b74dad708-tmp-dir\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:22:10.410932 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:10.410896    2563 generic.go:356] "Generic (PLEG): container finished" podID="eb8a83f3-74e2-48e5-886f-228b74dad708" containerID="c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31" exitCode=0
Jul 20 14:22:10.411084 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:10.410943    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"
Jul 20 14:22:10.411084 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:10.410962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8" event={"ID":"eb8a83f3-74e2-48e5-886f-228b74dad708","Type":"ContainerDied","Data":"c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31"}
Jul 20 14:22:10.411084 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:10.411000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8" event={"ID":"eb8a83f3-74e2-48e5-886f-228b74dad708","Type":"ContainerDied","Data":"0151ad640d8ebd79f355736b1a6c4a100ce72129f51d479da57b598553e8ce24"}
Jul 20 14:22:10.411084 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:10.411023    2563 scope.go:117] "RemoveContainer" containerID="c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31"
Jul 20 14:22:10.420104 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:10.420083    2563 scope.go:117] "RemoveContainer" containerID="c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31"
Jul 20 14:22:10.420398 ip-10-0-134-120 kubenswrapper[2563]: E0720 14:22:10.420380    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31\": container with ID starting with c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31 not found: ID does not exist" containerID="c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31"
Jul 20 14:22:10.420482 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:10.420425    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31"} err="failed to get container status \"c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31\": rpc error: code = NotFound desc = could not find container \"c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31\": container with ID starting with c5e62651cb69c43868dd3d98b98a436251c0f4d596ad600638091d356e6afc31 not found: ID does not exist"
Jul 20 14:22:10.431572 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:10.431538    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"]
Jul 20 14:22:10.435038 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:10.435010    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/auth-test-model-424aa6-kserve-7bd66b779f-wz5m8"]
Jul 20 14:22:10.945683 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:10.945647    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb8a83f3-74e2-48e5-886f-228b74dad708" path="/var/lib/kubelet/pods/eb8a83f3-74e2-48e5-886f-228b74dad708/volumes"
Jul 20 14:22:10.946071 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:10.946019    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb4e5cee-cf50-4559-b1e5-029bde9baf1b" path="/var/lib/kubelet/pods/fb4e5cee-cf50-4559-b1e5-029bde9baf1b/volumes"
Jul 20 14:22:29.157098 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.157062    2563 scope.go:117] "RemoveContainer" containerID="b31012cd7a79f82b9c8ea0fe1a0ec79133c91f9827dc58bc152ea23dc1d693b2"
Jul 20 14:22:29.939826 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.939788    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"]
Jul 20 14:22:29.940122 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.940108    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4e5cee-cf50-4559-b1e5-029bde9baf1b" containerName="main"
Jul 20 14:22:29.940168 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.940127    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4e5cee-cf50-4559-b1e5-029bde9baf1b" containerName="main"
Jul 20 14:22:29.940168 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.940163    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8a83f3-74e2-48e5-886f-228b74dad708" containerName="main"
Jul 20 14:22:29.940234 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.940173    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8a83f3-74e2-48e5-886f-228b74dad708" containerName="main"
Jul 20 14:22:29.940265 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.940253    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb4e5cee-cf50-4559-b1e5-029bde9baf1b" containerName="main"
Jul 20 14:22:29.940300 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.940266    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8a83f3-74e2-48e5-886f-228b74dad708" containerName="main"
Jul 20 14:22:29.945118 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.945090    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:29.947891 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.947871    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-57d0e8\"/\"default-dockercfg-5lpjq\""
Jul 20 14:22:29.948008 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.947873    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-57d0e8\"/\"kube-root-ca.crt\""
Jul 20 14:22:29.949142 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.949110    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-57d0e8\"/\"sub-test-model-57d0e8-kserve-self-signed-certs\""
Jul 20 14:22:29.949291 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.949112    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-57d0e8\"/\"openshift-service-ca.crt\""
Jul 20 14:22:29.952848 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:29.952827    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"]
Jul 20 14:22:30.087763 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.087726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-tmp-dir\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.087763 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.087775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-dshm\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.088047 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.087793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-home\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.088047 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.087886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzgcb\" (UniqueName: \"kubernetes.io/projected/595ae36c-e775-4567-b056-a4bae6b9d7a1-kube-api-access-zzgcb\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.088047 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.087952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-model-cache\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.088047 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.088004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595ae36c-e775-4567-b056-a4bae6b9d7a1-tls-certs\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.188631 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.188579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-model-cache\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.189116 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.188651    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595ae36c-e775-4567-b056-a4bae6b9d7a1-tls-certs\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.189116 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.188684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-tmp-dir\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.189116 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.188713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-dshm\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.189116 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.188737    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-home\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.189116 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.188780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzgcb\" (UniqueName: \"kubernetes.io/projected/595ae36c-e775-4567-b056-a4bae6b9d7a1-kube-api-access-zzgcb\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.189116 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.189053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-model-cache\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.189116 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.189074    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-tmp-dir\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.189376 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.189196    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-home\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.191207 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.191156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-dshm\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.191565 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.191545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595ae36c-e775-4567-b056-a4bae6b9d7a1-tls-certs\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.197862 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.197838    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzgcb\" (UniqueName: \"kubernetes.io/projected/595ae36c-e775-4567-b056-a4bae6b9d7a1-kube-api-access-zzgcb\") pod \"sub-test-model-57d0e8-kserve-6876484df-pwnzs\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") " pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.255078 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.255036    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:30.391250 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.391222    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"]
Jul 20 14:22:30.392841 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:22:30.392811    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod595ae36c_e775_4567_b056_a4bae6b9d7a1.slice/crio-e602b910bc49ef18198bbf476835436aca703e2e7734222d4fe4526f2eaa7ba6 WatchSource:0}: Error finding container e602b910bc49ef18198bbf476835436aca703e2e7734222d4fe4526f2eaa7ba6: Status 404 returned error can't find the container with id e602b910bc49ef18198bbf476835436aca703e2e7734222d4fe4526f2eaa7ba6
Jul 20 14:22:30.512749 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.512718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs" event={"ID":"595ae36c-e775-4567-b056-a4bae6b9d7a1","Type":"ContainerStarted","Data":"f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af"}
Jul 20 14:22:30.512749 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.512757    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs" event={"ID":"595ae36c-e775-4567-b056-a4bae6b9d7a1","Type":"ContainerStarted","Data":"e602b910bc49ef18198bbf476835436aca703e2e7734222d4fe4526f2eaa7ba6"}
Jul 20 14:22:30.533456 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:30.533381    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs" podStartSLOduration=1.533363276 podStartE2EDuration="1.533363276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:22:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:22:30.531817475 +0000 UTC m=+2642.079388860" watchObservedRunningTime="2026-07-20 14:22:30.533363276 +0000 UTC m=+2642.080934660"
Jul 20 14:22:33.670585 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:33.670550    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:22:40.255285 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:40.255247    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:40.255717 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:40.255299    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:40.267809 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:40.267780    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:40.570862 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:40.570831    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:22:57.649130 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.649094    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"]
Jul 20 14:22:57.652264 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.652248    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.654723 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.654704    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-424aa6\"/\"openshift-service-ca.crt\""
Jul 20 14:22:57.655690 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.655669    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-424aa6\"/\"default-dockercfg-mz252\""
Jul 20 14:22:57.655817 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.655669    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-424aa6\"/\"sub-test-model-424aa6-kserve-self-signed-certs\""
Jul 20 14:22:57.655817 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.655675    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-424aa6\"/\"kube-root-ca.crt\""
Jul 20 14:22:57.663066 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.663044    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"]
Jul 20 14:22:57.711026 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.710985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-model-cache\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.711292 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.711263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-dshm\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.711438 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.711340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-home\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.711438 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.711365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-tls-certs\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.711438 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.711421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwtzw\" (UniqueName: \"kubernetes.io/projected/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-kube-api-access-lwtzw\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.711608 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.711480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-tmp-dir\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.812139 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.812101    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-tmp-dir\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.812327 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.812156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-model-cache\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.812327 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.812270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-dshm\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.812456 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.812341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-home\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.812456 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.812365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-tls-certs\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.812456 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.812437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtzw\" (UniqueName: \"kubernetes.io/projected/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-kube-api-access-lwtzw\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.812598 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.812532    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-model-cache\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.812598 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.812581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-tmp-dir\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.812803 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.812778    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-home\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.814648 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.814629    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-dshm\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.814929 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.814910    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-tls-certs\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.821756 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.821734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwtzw\" (UniqueName: \"kubernetes.io/projected/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-kube-api-access-lwtzw\") pod \"sub-test-model-424aa6-kserve-b77b9b587-lzplq\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") " pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:57.962344 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:57.962270    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:22:58.095091 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:58.095061    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"]
Jul 20 14:22:58.097029 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:22:58.097005    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04f6b5c1_75d2_4a6c_81c9_735e533f3d29.slice/crio-111f01c4f09d631a3432f05755994fdca74a30bca130d23df2139117dd49cd40 WatchSource:0}: Error finding container 111f01c4f09d631a3432f05755994fdca74a30bca130d23df2139117dd49cd40: Status 404 returned error can't find the container with id 111f01c4f09d631a3432f05755994fdca74a30bca130d23df2139117dd49cd40
Jul 20 14:22:58.646274 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:58.646240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq" event={"ID":"04f6b5c1-75d2-4a6c-81c9-735e533f3d29","Type":"ContainerStarted","Data":"a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86"}
Jul 20 14:22:58.646471 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:58.646284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq" event={"ID":"04f6b5c1-75d2-4a6c-81c9-735e533f3d29","Type":"ContainerStarted","Data":"111f01c4f09d631a3432f05755994fdca74a30bca130d23df2139117dd49cd40"}
Jul 20 14:22:58.663738 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:22:58.663692    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq" podStartSLOduration=1.663673561 podStartE2EDuration="1.663673561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:22:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:22:58.662069019 +0000 UTC m=+2670.209640404" watchObservedRunningTime="2026-07-20 14:22:58.663673561 +0000 UTC m=+2670.211244945"
Jul 20 14:23:01.559902 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:23:01.559869    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:23:07.962901 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:23:07.962868    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:23:07.963327 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:23:07.962915    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:23:07.975880 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:23:07.975857    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:23:08.704907 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:23:08.704872    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:23:20.755314 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:23:20.755222    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:23:29.184326 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:23:29.184295    2563 scope.go:117] "RemoveContainer" containerID="bde4045718e8ebda9aed97408cf15173c035a4ebc0f70cbc96beb140ac235d1c"
Jul 20 14:23:29.192977 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:23:29.192948    2563 scope.go:117] "RemoveContainer" containerID="067346528cba29a0d828c360d055bfa35cd88c2034e0ba87886eb3e3c2bcad8d"
Jul 20 14:23:38.757088 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:23:38.757049    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:23:45.356240 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:23:45.356206    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"]
Jul 20 14:23:46.247362 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:23:46.247324    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"]
Jul 20 14:23:56.751752 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:23:56.751709    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:24:00.376737 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.376652    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs" podUID="595ae36c-e775-4567-b056-a4bae6b9d7a1" containerName="main" containerID="cri-o://f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af" gracePeriod=45
Jul 20 14:24:00.625678 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.625650    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:24:00.723078 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.722983    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-model-cache\") pod \"595ae36c-e775-4567-b056-a4bae6b9d7a1\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") "
Jul 20 14:24:00.723078 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.723028    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595ae36c-e775-4567-b056-a4bae6b9d7a1-tls-certs\") pod \"595ae36c-e775-4567-b056-a4bae6b9d7a1\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") "
Jul 20 14:24:00.723078 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.723049    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-tmp-dir\") pod \"595ae36c-e775-4567-b056-a4bae6b9d7a1\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") "
Jul 20 14:24:00.723364 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.723083    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-dshm\") pod \"595ae36c-e775-4567-b056-a4bae6b9d7a1\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") "
Jul 20 14:24:00.723364 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.723110    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-home\") pod \"595ae36c-e775-4567-b056-a4bae6b9d7a1\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") "
Jul 20 14:24:00.723364 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.723128    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzgcb\" (UniqueName: \"kubernetes.io/projected/595ae36c-e775-4567-b056-a4bae6b9d7a1-kube-api-access-zzgcb\") pod \"595ae36c-e775-4567-b056-a4bae6b9d7a1\" (UID: \"595ae36c-e775-4567-b056-a4bae6b9d7a1\") "
Jul 20 14:24:00.723364 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.723332    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "595ae36c-e775-4567-b056-a4bae6b9d7a1" (UID: "595ae36c-e775-4567-b056-a4bae6b9d7a1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:24:00.723584 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.723339    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-model-cache" (OuterVolumeSpecName: "model-cache") pod "595ae36c-e775-4567-b056-a4bae6b9d7a1" (UID: "595ae36c-e775-4567-b056-a4bae6b9d7a1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:24:00.723584 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.723459    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-home" (OuterVolumeSpecName: "home") pod "595ae36c-e775-4567-b056-a4bae6b9d7a1" (UID: "595ae36c-e775-4567-b056-a4bae6b9d7a1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:24:00.725437 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.725399    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/595ae36c-e775-4567-b056-a4bae6b9d7a1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "595ae36c-e775-4567-b056-a4bae6b9d7a1" (UID: "595ae36c-e775-4567-b056-a4bae6b9d7a1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:24:00.725437 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.725417    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/595ae36c-e775-4567-b056-a4bae6b9d7a1-kube-api-access-zzgcb" (OuterVolumeSpecName: "kube-api-access-zzgcb") pod "595ae36c-e775-4567-b056-a4bae6b9d7a1" (UID: "595ae36c-e775-4567-b056-a4bae6b9d7a1"). InnerVolumeSpecName "kube-api-access-zzgcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:24:00.725561 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.725467    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-dshm" (OuterVolumeSpecName: "dshm") pod "595ae36c-e775-4567-b056-a4bae6b9d7a1" (UID: "595ae36c-e775-4567-b056-a4bae6b9d7a1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:24:00.824278 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.824239    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-dshm\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:24:00.824278 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.824272    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-home\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:24:00.824278 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.824282    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzgcb\" (UniqueName: \"kubernetes.io/projected/595ae36c-e775-4567-b056-a4bae6b9d7a1-kube-api-access-zzgcb\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:24:00.824542 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.824291    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-model-cache\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:24:00.824542 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.824300    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595ae36c-e775-4567-b056-a4bae6b9d7a1-tls-certs\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:24:00.824542 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.824307    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/595ae36c-e775-4567-b056-a4bae6b9d7a1-tmp-dir\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:24:00.945719 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.945681    2563 generic.go:356] "Generic (PLEG): container finished" podID="595ae36c-e775-4567-b056-a4bae6b9d7a1" containerID="f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af" exitCode=0
Jul 20 14:24:00.945719 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.945719    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"
Jul 20 14:24:00.945980 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.945772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs" event={"ID":"595ae36c-e775-4567-b056-a4bae6b9d7a1","Type":"ContainerDied","Data":"f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af"}
Jul 20 14:24:00.945980 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.945809    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs" event={"ID":"595ae36c-e775-4567-b056-a4bae6b9d7a1","Type":"ContainerDied","Data":"e602b910bc49ef18198bbf476835436aca703e2e7734222d4fe4526f2eaa7ba6"}
Jul 20 14:24:00.945980 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.945825    2563 scope.go:117] "RemoveContainer" containerID="f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af"
Jul 20 14:24:00.955506 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.955489    2563 scope.go:117] "RemoveContainer" containerID="f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af"
Jul 20 14:24:00.955764 ip-10-0-134-120 kubenswrapper[2563]: E0720 14:24:00.955743    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af\": container with ID starting with f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af not found: ID does not exist" containerID="f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af"
Jul 20 14:24:00.955849 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.955770    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af"} err="failed to get container status \"f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af\": rpc error: code = NotFound desc = could not find container \"f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af\": container with ID starting with f9698c2d6b4f6d22d8900893e354095ba5328f1d152ff877cc51d2848c1d27af not found: ID does not exist"
Jul 20 14:24:00.969043 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.969013    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"]
Jul 20 14:24:00.973496 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:00.973431    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs"]
Jul 20 14:24:01.267773 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.267673    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq" podUID="04f6b5c1-75d2-4a6c-81c9-735e533f3d29" containerName="main" containerID="cri-o://a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86" gracePeriod=45
Jul 20 14:24:01.524666 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.524595    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:24:01.631890 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.631857    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-tls-certs\") pod \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") "
Jul 20 14:24:01.632146 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.631900    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-tmp-dir\") pod \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") "
Jul 20 14:24:01.632146 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.631953    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-model-cache\") pod \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") "
Jul 20 14:24:01.632146 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.632062    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-home\") pod \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") "
Jul 20 14:24:01.632146 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.632101    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-dshm\") pod \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") "
Jul 20 14:24:01.632146 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.632135    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwtzw\" (UniqueName: \"kubernetes.io/projected/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-kube-api-access-lwtzw\") pod \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\" (UID: \"04f6b5c1-75d2-4a6c-81c9-735e533f3d29\") "
Jul 20 14:24:01.632437 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.632181    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-model-cache" (OuterVolumeSpecName: "model-cache") pod "04f6b5c1-75d2-4a6c-81c9-735e533f3d29" (UID: "04f6b5c1-75d2-4a6c-81c9-735e533f3d29"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:24:01.632437 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.632221    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "04f6b5c1-75d2-4a6c-81c9-735e533f3d29" (UID: "04f6b5c1-75d2-4a6c-81c9-735e533f3d29"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:24:01.632437 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.632330    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-home" (OuterVolumeSpecName: "home") pod "04f6b5c1-75d2-4a6c-81c9-735e533f3d29" (UID: "04f6b5c1-75d2-4a6c-81c9-735e533f3d29"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:24:01.632595 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.632456    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-model-cache\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:24:01.632595 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.632471    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-home\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:24:01.632595 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.632480    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-tmp-dir\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:24:01.634180 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.634155    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "04f6b5c1-75d2-4a6c-81c9-735e533f3d29" (UID: "04f6b5c1-75d2-4a6c-81c9-735e533f3d29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:24:01.634314 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.634295    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-kube-api-access-lwtzw" (OuterVolumeSpecName: "kube-api-access-lwtzw") pod "04f6b5c1-75d2-4a6c-81c9-735e533f3d29" (UID: "04f6b5c1-75d2-4a6c-81c9-735e533f3d29"). InnerVolumeSpecName "kube-api-access-lwtzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:24:01.634374 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.634299    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-dshm" (OuterVolumeSpecName: "dshm") pod "04f6b5c1-75d2-4a6c-81c9-735e533f3d29" (UID: "04f6b5c1-75d2-4a6c-81c9-735e533f3d29"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:24:01.733628 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.733592    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-dshm\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:24:01.733628 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.733621    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwtzw\" (UniqueName: \"kubernetes.io/projected/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-kube-api-access-lwtzw\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:24:01.733628 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.733635    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04f6b5c1-75d2-4a6c-81c9-735e533f3d29-tls-certs\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:24:01.952709 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.952669    2563 generic.go:356] "Generic (PLEG): container finished" podID="04f6b5c1-75d2-4a6c-81c9-735e533f3d29" containerID="a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86" exitCode=0
Jul 20 14:24:01.952709 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.952714    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"
Jul 20 14:24:01.952956 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.952750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq" event={"ID":"04f6b5c1-75d2-4a6c-81c9-735e533f3d29","Type":"ContainerDied","Data":"a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86"}
Jul 20 14:24:01.952956 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.952788    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq" event={"ID":"04f6b5c1-75d2-4a6c-81c9-735e533f3d29","Type":"ContainerDied","Data":"111f01c4f09d631a3432f05755994fdca74a30bca130d23df2139117dd49cd40"}
Jul 20 14:24:01.952956 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.952805    2563 scope.go:117] "RemoveContainer" containerID="a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86"
Jul 20 14:24:01.962093 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.962075    2563 scope.go:117] "RemoveContainer" containerID="a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86"
Jul 20 14:24:01.962329 ip-10-0-134-120 kubenswrapper[2563]: E0720 14:24:01.962311    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86\": container with ID starting with a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86 not found: ID does not exist" containerID="a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86"
Jul 20 14:24:01.962378 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.962336    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86"} err="failed to get container status \"a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86\": rpc error: code = NotFound desc = could not find container \"a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86\": container with ID starting with a2175f25acdb55b1b1562e064909e28320aaa0268b79ee93c92d88ae0bf3ba86 not found: ID does not exist"
Jul 20 14:24:01.972949 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.972923    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"]
Jul 20 14:24:01.979859 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:01.977606    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/sub-test-model-424aa6-kserve-b77b9b587-lzplq"]
Jul 20 14:24:02.945307 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:02.945267    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04f6b5c1-75d2-4a6c-81c9-735e533f3d29" path="/var/lib/kubelet/pods/04f6b5c1-75d2-4a6c-81c9-735e533f3d29/volumes"
Jul 20 14:24:02.945698 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:02.945647    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="595ae36c-e775-4567-b056-a4bae6b9d7a1" path="/var/lib/kubelet/pods/595ae36c-e775-4567-b056-a4bae6b9d7a1/volumes"
Jul 20 14:24:05.560970 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:05.560923    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-57d0e8/sub-test-model-57d0e8-kserve-6876484df-pwnzs" podUID="595ae36c-e775-4567-b056-a4bae6b9d7a1" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded"
Jul 20 14:24:09.852712 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.852677    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"]
Jul 20 14:24:09.853118 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.852977    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="595ae36c-e775-4567-b056-a4bae6b9d7a1" containerName="main"
Jul 20 14:24:09.853118 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.852988    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="595ae36c-e775-4567-b056-a4bae6b9d7a1" containerName="main"
Jul 20 14:24:09.853118 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.853007    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f6b5c1-75d2-4a6c-81c9-735e533f3d29" containerName="main"
Jul 20 14:24:09.853118 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.853013    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f6b5c1-75d2-4a6c-81c9-735e533f3d29" containerName="main"
Jul 20 14:24:09.853118 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.853072    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="595ae36c-e775-4567-b056-a4bae6b9d7a1" containerName="main"
Jul 20 14:24:09.853118 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.853080    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="04f6b5c1-75d2-4a6c-81c9-735e533f3d29" containerName="main"
Jul 20 14:24:09.855850 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.855834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:09.859273 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.859249    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-57d0e8\"/\"kube-root-ca.crt\""
Jul 20 14:24:09.859273 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.859267    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-57d0e8\"/\"default-dockercfg-5lpjq\""
Jul 20 14:24:09.859483 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.859258    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-57d0e8\"/\"rate-test-model-57d0e8-kserve-self-signed-certs\""
Jul 20 14:24:09.859483 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.859290    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-57d0e8\"/\"openshift-service-ca.crt\""
Jul 20 14:24:09.866098 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.866077    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"]
Jul 20 14:24:09.899748 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.899702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-tmp-dir\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:09.899927 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.899768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmht2\" (UniqueName: \"kubernetes.io/projected/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-kube-api-access-cmht2\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:09.899927 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.899799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-model-cache\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:09.899927 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.899824    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-home\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:09.899927 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.899848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-dshm\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:09.899927 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:09.899873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-tls-certs\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.000697 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.000669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-tmp-dir\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.000895 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.000721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmht2\" (UniqueName: \"kubernetes.io/projected/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-kube-api-access-cmht2\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.000895 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.000751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-model-cache\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.000895 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.000779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-home\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.000895 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.000802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-dshm\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.000895 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.000829    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-tls-certs\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.001158 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.001085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-tmp-dir\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.001158 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.001133    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-model-cache\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.001158 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.001149    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-home\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.003220 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.003188    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-dshm\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.003389 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.003375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-tls-certs\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.008197 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.008181    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmht2\" (UniqueName: \"kubernetes.io/projected/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-kube-api-access-cmht2\") pod \"rate-test-model-57d0e8-kserve-6df7cd55f5-td26c\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") " pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.165057 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.164961    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:10.301666 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.301512    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"]
Jul 20 14:24:10.303893 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:24:10.303865    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ed8c77e_c6b3_48c6_94ab_4c31106d93d1.slice/crio-a93b2e5e1331bf106a83b018a101971265e77d8cf11eabeb34fdfe6a4aff0f46 WatchSource:0}: Error finding container a93b2e5e1331bf106a83b018a101971265e77d8cf11eabeb34fdfe6a4aff0f46: Status 404 returned error can't find the container with id a93b2e5e1331bf106a83b018a101971265e77d8cf11eabeb34fdfe6a4aff0f46
Jul 20 14:24:10.997066 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.997033    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c" event={"ID":"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1","Type":"ContainerStarted","Data":"d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3"}
Jul 20 14:24:10.997066 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:10.997073    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c" event={"ID":"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1","Type":"ContainerStarted","Data":"a93b2e5e1331bf106a83b018a101971265e77d8cf11eabeb34fdfe6a4aff0f46"}
Jul 20 14:24:11.013967 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:11.013917    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c" podStartSLOduration=2.013900477 podStartE2EDuration="2.013900477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:24:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:24:11.012224416 +0000 UTC m=+2742.559795802" watchObservedRunningTime="2026-07-20 14:24:11.013900477 +0000 UTC m=+2742.561471892"
Jul 20 14:24:13.449923 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:13.449886    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:24:20.165294 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:20.165248    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:20.165294 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:20.165303    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:20.177611 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:20.177584    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:21.055623 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:21.055582    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:24:29.215135 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:24:29.215103    2563 scope.go:117] "RemoveContainer" containerID="8a2e8df2491e2068fbc099806b694e71379c375c28b25d65347c2aa0b0faf64f"
Jul 20 14:25:00.852194 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.852098    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"]
Jul 20 14:25:00.855611 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.855591    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:00.859102 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.859080    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-424aa6\"/\"openshift-service-ca.crt\""
Jul 20 14:25:00.859102 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.859093    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-424aa6\"/\"default-dockercfg-mz252\""
Jul 20 14:25:00.859297 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.859103    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-424aa6\"/\"kube-root-ca.crt\""
Jul 20 14:25:00.859297 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.859150    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-424aa6\"/\"rate-test-model-424aa6-kserve-self-signed-certs\""
Jul 20 14:25:00.864586 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.864565    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"]
Jul 20 14:25:00.921698 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.921660    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-home\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:00.921698 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.921697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-tls-certs\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:00.921920 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.921728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88xn5\" (UniqueName: \"kubernetes.io/projected/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-kube-api-access-88xn5\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:00.921920 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.921785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-tmp-dir\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:00.921920 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.921830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-dshm\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:00.921920 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:00.921852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-model-cache\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.022672 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.022637    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-home\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.022672 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.022673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-tls-certs\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.022934 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.022704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88xn5\" (UniqueName: \"kubernetes.io/projected/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-kube-api-access-88xn5\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.022934 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.022726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-tmp-dir\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.022934 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.022759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-dshm\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.022934 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.022778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-model-cache\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.023148 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.023047    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-home\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.023189 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.023151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-model-cache\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.023189 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.023176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-tmp-dir\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.025183 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.025161    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-dshm\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.025457 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.025439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-tls-certs\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.029975 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.029954    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88xn5\" (UniqueName: \"kubernetes.io/projected/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-kube-api-access-88xn5\") pod \"rate-test-model-424aa6-kserve-56d794b6c5-vp5j9\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") " pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.165612 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.165520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:01.301790 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:01.301765    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"]
Jul 20 14:25:01.303932 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:25:01.303905    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dde19ca_cbbc_48c4_9b96_a1b84ec2cb7c.slice/crio-05be38afe94f3853ffcdc726822a21f1a25c6b2092ba3aa916263adee5721a19 WatchSource:0}: Error finding container 05be38afe94f3853ffcdc726822a21f1a25c6b2092ba3aa916263adee5721a19: Status 404 returned error can't find the container with id 05be38afe94f3853ffcdc726822a21f1a25c6b2092ba3aa916263adee5721a19
Jul 20 14:25:02.239056 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:02.239016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9" event={"ID":"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c","Type":"ContainerStarted","Data":"d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a"}
Jul 20 14:25:02.239474 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:02.239063    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9" event={"ID":"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c","Type":"ContainerStarted","Data":"05be38afe94f3853ffcdc726822a21f1a25c6b2092ba3aa916263adee5721a19"}
Jul 20 14:25:02.257515 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:02.257456    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9" podStartSLOduration=2.2574370950000002 podStartE2EDuration="2.257437095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:25:02.254855493 +0000 UTC m=+2793.802426872" watchObservedRunningTime="2026-07-20 14:25:02.257437095 +0000 UTC m=+2793.805008521"
Jul 20 14:25:04.644955 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:04.644917    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:25:11.166384 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:11.166328    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:11.166824 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:11.166442    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:11.179014 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:11.178991    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:11.300777 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:11.300744    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:25:22.576881 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:22.576848    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:25:39.452467 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:39.452431    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:25:45.275439 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:45.275392    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"]
Jul 20 14:25:46.228357 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:46.228323    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"]
Jul 20 14:25:47.230232 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:47.230194    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7393-139986656906032"]
Jul 20 14:25:47.233429 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:47.233392    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656906032"
Jul 20 14:25:47.235620 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:47.235602    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pf8kf\""
Jul 20 14:25:47.239189 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:47.239161    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-139986656906032"]
Jul 20 14:25:47.416634 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:47.416593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75wrk\" (UniqueName: \"kubernetes.io/projected/c4d08620-68b5-48d1-8690-124795595875-kube-api-access-75wrk\") pod \"test-curl-7393-139986656906032\" (UID: \"c4d08620-68b5-48d1-8690-124795595875\") " pod="opendatahub/test-curl-7393-139986656906032"
Jul 20 14:25:47.517766 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:47.517675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wrk\" (UniqueName: \"kubernetes.io/projected/c4d08620-68b5-48d1-8690-124795595875-kube-api-access-75wrk\") pod \"test-curl-7393-139986656906032\" (UID: \"c4d08620-68b5-48d1-8690-124795595875\") " pod="opendatahub/test-curl-7393-139986656906032"
Jul 20 14:25:47.525799 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:47.525770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75wrk\" (UniqueName: \"kubernetes.io/projected/c4d08620-68b5-48d1-8690-124795595875-kube-api-access-75wrk\") pod \"test-curl-7393-139986656906032\" (UID: \"c4d08620-68b5-48d1-8690-124795595875\") " pod="opendatahub/test-curl-7393-139986656906032"
Jul 20 14:25:47.543910 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:47.543889    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656906032"
Jul 20 14:25:47.675882 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:47.675857    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-139986656906032"]
Jul 20 14:25:47.677551 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:25:47.677523    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4d08620_68b5_48d1_8690_124795595875.slice/crio-c376e72b915b416120c70ca9efd4a0f3741c7f8fc94e2b7890410bb0786de800 WatchSource:0}: Error finding container c376e72b915b416120c70ca9efd4a0f3741c7f8fc94e2b7890410bb0786de800: Status 404 returned error can't find the container with id c376e72b915b416120c70ca9efd4a0f3741c7f8fc94e2b7890410bb0786de800
Jul 20 14:25:47.678838 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:47.678820    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 14:25:48.471517 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:48.471487    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986656906032" event={"ID":"c4d08620-68b5-48d1-8690-124795595875","Type":"ContainerStarted","Data":"58e09122c9ae2fb9d723a73f5d2eddfc4b57f4e9be302d84e2345b0951587e90"}
Jul 20 14:25:48.471827 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:48.471526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986656906032" event={"ID":"c4d08620-68b5-48d1-8690-124795595875","Type":"ContainerStarted","Data":"c376e72b915b416120c70ca9efd4a0f3741c7f8fc94e2b7890410bb0786de800"}
Jul 20 14:25:48.487188 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:48.487146    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7393-139986656906032" podStartSLOduration=0.780244766 podStartE2EDuration="1.487131425s" totalImagesPullingTime="706.886659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:25:48.486101989 +0000 UTC m=+2840.033673375" watchObservedRunningTime="2026-07-20 14:25:48.487131425 +0000 UTC m=+2840.034702810"
Jul 20 14:25:48.602159 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:48.602123    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7393-139986656906032_c4d08620-68b5-48d1-8690-124795595875/test-curl-7393-139986656906032/0.log"
Jul 20 14:25:49.477583 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:49.477542    2563 generic.go:356] "Generic (PLEG): container finished" podID="c4d08620-68b5-48d1-8690-124795595875" containerID="58e09122c9ae2fb9d723a73f5d2eddfc4b57f4e9be302d84e2345b0951587e90" exitCode=0
Jul 20 14:25:49.478000 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:49.477636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986656906032" event={"ID":"c4d08620-68b5-48d1-8690-124795595875","Type":"ContainerDied","Data":"58e09122c9ae2fb9d723a73f5d2eddfc4b57f4e9be302d84e2345b0951587e90"}
Jul 20 14:25:50.622696 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.622669    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656906032"
Jul 20 14:25:50.662321 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.662284    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7393-139986656906032"]
Jul 20 14:25:50.665708 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.665683    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7393-139986656906032"]
Jul 20 14:25:50.748222 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.748139    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75wrk\" (UniqueName: \"kubernetes.io/projected/c4d08620-68b5-48d1-8690-124795595875-kube-api-access-75wrk\") pod \"c4d08620-68b5-48d1-8690-124795595875\" (UID: \"c4d08620-68b5-48d1-8690-124795595875\") "
Jul 20 14:25:50.750486 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.750459    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4d08620-68b5-48d1-8690-124795595875-kube-api-access-75wrk" (OuterVolumeSpecName: "kube-api-access-75wrk") pod "c4d08620-68b5-48d1-8690-124795595875" (UID: "c4d08620-68b5-48d1-8690-124795595875"). InnerVolumeSpecName "kube-api-access-75wrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:25:50.797168 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.797130    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7393-139986653635120"]
Jul 20 14:25:50.797541 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.797522    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4d08620-68b5-48d1-8690-124795595875" containerName="test-curl-7393-139986656906032"
Jul 20 14:25:50.797636 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.797543    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4d08620-68b5-48d1-8690-124795595875" containerName="test-curl-7393-139986656906032"
Jul 20 14:25:50.797699 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.797654    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4d08620-68b5-48d1-8690-124795595875" containerName="test-curl-7393-139986656906032"
Jul 20 14:25:50.800758 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.800735    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986653635120"
Jul 20 14:25:50.808539 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.808515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-139986653635120"]
Jul 20 14:25:50.849335 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.849307    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75wrk\" (UniqueName: \"kubernetes.io/projected/c4d08620-68b5-48d1-8690-124795595875-kube-api-access-75wrk\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:25:50.945750 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.945718    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4d08620-68b5-48d1-8690-124795595875" path="/var/lib/kubelet/pods/c4d08620-68b5-48d1-8690-124795595875/volumes"
Jul 20 14:25:50.949656 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:50.949637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vkw\" (UniqueName: \"kubernetes.io/projected/5160fb58-9fdb-45c8-9492-7f0a52316386-kube-api-access-49vkw\") pod \"test-curl-7393-139986653635120\" (UID: \"5160fb58-9fdb-45c8-9492-7f0a52316386\") " pod="opendatahub/test-curl-7393-139986653635120"
Jul 20 14:25:51.050745 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:51.050660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vkw\" (UniqueName: \"kubernetes.io/projected/5160fb58-9fdb-45c8-9492-7f0a52316386-kube-api-access-49vkw\") pod \"test-curl-7393-139986653635120\" (UID: \"5160fb58-9fdb-45c8-9492-7f0a52316386\") " pod="opendatahub/test-curl-7393-139986653635120"
Jul 20 14:25:51.060764 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:51.060733    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vkw\" (UniqueName: \"kubernetes.io/projected/5160fb58-9fdb-45c8-9492-7f0a52316386-kube-api-access-49vkw\") pod \"test-curl-7393-139986653635120\" (UID: \"5160fb58-9fdb-45c8-9492-7f0a52316386\") " pod="opendatahub/test-curl-7393-139986653635120"
Jul 20 14:25:51.111775 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:51.111717    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986653635120"
Jul 20 14:25:51.247765 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:51.247740    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-139986653635120"]
Jul 20 14:25:51.249914 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:25:51.249888    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5160fb58_9fdb_45c8_9492_7f0a52316386.slice/crio-2ce477bf1e85a402a4cd1efc0b092a91f5d2be403bb3b0fda3069c5ddb8fe339 WatchSource:0}: Error finding container 2ce477bf1e85a402a4cd1efc0b092a91f5d2be403bb3b0fda3069c5ddb8fe339: Status 404 returned error can't find the container with id 2ce477bf1e85a402a4cd1efc0b092a91f5d2be403bb3b0fda3069c5ddb8fe339
Jul 20 14:25:51.487525 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:51.487499    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656906032"
Jul 20 14:25:51.487720 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:51.487562    2563 scope.go:117] "RemoveContainer" containerID="58e09122c9ae2fb9d723a73f5d2eddfc4b57f4e9be302d84e2345b0951587e90"
Jul 20 14:25:51.488797 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:51.488678    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986653635120" event={"ID":"5160fb58-9fdb-45c8-9492-7f0a52316386","Type":"ContainerStarted","Data":"2ce477bf1e85a402a4cd1efc0b092a91f5d2be403bb3b0fda3069c5ddb8fe339"}
Jul 20 14:25:52.494814 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:52.494779    2563 generic.go:356] "Generic (PLEG): container finished" podID="5160fb58-9fdb-45c8-9492-7f0a52316386" containerID="066eeddfc8642d9a11ff4e156acdd30000d9e7c897d10691911396376e2df649" exitCode=0
Jul 20 14:25:52.495264 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:52.494860    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986653635120" event={"ID":"5160fb58-9fdb-45c8-9492-7f0a52316386","Type":"ContainerDied","Data":"066eeddfc8642d9a11ff4e156acdd30000d9e7c897d10691911396376e2df649"}
Jul 20 14:25:53.636123 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.636091    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986653635120"
Jul 20 14:25:53.657215 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.657191    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7393-139986653635120_5160fb58-9fdb-45c8-9492-7f0a52316386/test-curl-7393-139986653635120/0.log"
Jul 20 14:25:53.672522 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.672499    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49vkw\" (UniqueName: \"kubernetes.io/projected/5160fb58-9fdb-45c8-9492-7f0a52316386-kube-api-access-49vkw\") pod \"5160fb58-9fdb-45c8-9492-7f0a52316386\" (UID: \"5160fb58-9fdb-45c8-9492-7f0a52316386\") "
Jul 20 14:25:53.674629 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.674599    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5160fb58-9fdb-45c8-9492-7f0a52316386-kube-api-access-49vkw" (OuterVolumeSpecName: "kube-api-access-49vkw") pod "5160fb58-9fdb-45c8-9492-7f0a52316386" (UID: "5160fb58-9fdb-45c8-9492-7f0a52316386"). InnerVolumeSpecName "kube-api-access-49vkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:25:53.680247 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.680220    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7393-139986653635120"]
Jul 20 14:25:53.684522 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.684502    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7393-139986653635120"]
Jul 20 14:25:53.773080 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.773005    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49vkw\" (UniqueName: \"kubernetes.io/projected/5160fb58-9fdb-45c8-9492-7f0a52316386-kube-api-access-49vkw\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:25:53.838920 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.838888    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7393-139986656743120"]
Jul 20 14:25:53.839201 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.839189    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5160fb58-9fdb-45c8-9492-7f0a52316386" containerName="test-curl-7393-139986653635120"
Jul 20 14:25:53.839246 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.839203    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5160fb58-9fdb-45c8-9492-7f0a52316386" containerName="test-curl-7393-139986653635120"
Jul 20 14:25:53.839279 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.839254    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5160fb58-9fdb-45c8-9492-7f0a52316386" containerName="test-curl-7393-139986653635120"
Jul 20 14:25:53.842006 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.841991    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:53.846123 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.846098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-139986656743120"]
Jul 20 14:25:53.874138 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.874103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pjgd\" (UniqueName: \"kubernetes.io/projected/0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def-kube-api-access-4pjgd\") pod \"test-curl-7393-139986656743120\" (UID: \"0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def\") " pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:53.975481 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.975445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pjgd\" (UniqueName: \"kubernetes.io/projected/0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def-kube-api-access-4pjgd\") pod \"test-curl-7393-139986656743120\" (UID: \"0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def\") " pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:53.983422 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:53.983384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pjgd\" (UniqueName: \"kubernetes.io/projected/0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def-kube-api-access-4pjgd\") pod \"test-curl-7393-139986656743120\" (UID: \"0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def\") " pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:54.153237 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:54.153202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:54.283629 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:54.283597    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-139986656743120"]
Jul 20 14:25:54.287141 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:25:54.287114    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e1fb08d_1ac7_4b9b_a82f_c6a6d6344def.slice/crio-5ed792d23672c58df2d2c4f814c0f745fd378bd30dd69c9de6b9e1dfed2baccb WatchSource:0}: Error finding container 5ed792d23672c58df2d2c4f814c0f745fd378bd30dd69c9de6b9e1dfed2baccb: Status 404 returned error can't find the container with id 5ed792d23672c58df2d2c4f814c0f745fd378bd30dd69c9de6b9e1dfed2baccb
Jul 20 14:25:54.507040 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:54.506956    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986653635120"
Jul 20 14:25:54.507040 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:54.506993    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ce477bf1e85a402a4cd1efc0b092a91f5d2be403bb3b0fda3069c5ddb8fe339"
Jul 20 14:25:54.508262 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:54.508237    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986656743120" event={"ID":"0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def","Type":"ContainerStarted","Data":"5ed792d23672c58df2d2c4f814c0f745fd378bd30dd69c9de6b9e1dfed2baccb"}
Jul 20 14:25:54.517049 ip-10-0-134-120 kubenswrapper[2563]: E0720 14:25:54.517022    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7393-139986653635120\" is forbidden: User \"system:node:ip-10-0-134-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-120.ec2.internal' and this object" podUID="5160fb58-9fdb-45c8-9492-7f0a52316386" pod="opendatahub/test-curl-7393-139986653635120"
Jul 20 14:25:54.946102 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:54.946070    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5160fb58-9fdb-45c8-9492-7f0a52316386" path="/var/lib/kubelet/pods/5160fb58-9fdb-45c8-9492-7f0a52316386/volumes"
Jul 20 14:25:55.514477 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:55.514446    2563 generic.go:356] "Generic (PLEG): container finished" podID="0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def" containerID="ad344281adf88c60d60eb2ec161964be542dbb56c6c74336a7c62a9a33f28697" exitCode=0
Jul 20 14:25:55.514655 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:55.514536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986656743120" event={"ID":"0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def","Type":"ContainerDied","Data":"ad344281adf88c60d60eb2ec161964be542dbb56c6c74336a7c62a9a33f28697"}
Jul 20 14:25:56.653495 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.653472    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:56.672358 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.672336    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7393-139986656743120_0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def/test-curl-7393-139986656743120/0.log"
Jul 20 14:25:56.697789 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.697762    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7393-139986656743120"]
Jul 20 14:25:56.697921 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.697881    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pjgd\" (UniqueName: \"kubernetes.io/projected/0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def-kube-api-access-4pjgd\") pod \"0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def\" (UID: \"0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def\") "
Jul 20 14:25:56.700352 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.700322    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def-kube-api-access-4pjgd" (OuterVolumeSpecName: "kube-api-access-4pjgd") pod "0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def" (UID: "0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def"). InnerVolumeSpecName "kube-api-access-4pjgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:25:56.701602 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.701583    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7393-139986656743120"]
Jul 20 14:25:56.798643 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.798567    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pjgd\" (UniqueName: \"kubernetes.io/projected/0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def-kube-api-access-4pjgd\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:25:56.822702 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.822672    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7393-139986656743120"]
Jul 20 14:25:56.822972 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.822959    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def" containerName="test-curl-7393-139986656743120"
Jul 20 14:25:56.823014 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.822973    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def" containerName="test-curl-7393-139986656743120"
Jul 20 14:25:56.823058 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.823038    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def" containerName="test-curl-7393-139986656743120"
Jul 20 14:25:56.825753 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.825739    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:56.843529 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.839349    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-139986656743120"]
Jul 20 14:25:56.899132 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.899099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxn8j\" (UniqueName: \"kubernetes.io/projected/a08873b1-8408-4e7a-aa10-abfdb637b3c0-kube-api-access-gxn8j\") pod \"test-curl-7393-139986656743120\" (UID: \"a08873b1-8408-4e7a-aa10-abfdb637b3c0\") " pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:56.945487 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:56.945458    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def" path="/var/lib/kubelet/pods/0e1fb08d-1ac7-4b9b-a82f-c6a6d6344def/volumes"
Jul 20 14:25:57.000052 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:57.000025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxn8j\" (UniqueName: \"kubernetes.io/projected/a08873b1-8408-4e7a-aa10-abfdb637b3c0-kube-api-access-gxn8j\") pod \"test-curl-7393-139986656743120\" (UID: \"a08873b1-8408-4e7a-aa10-abfdb637b3c0\") " pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:57.008656 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:57.008632    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxn8j\" (UniqueName: \"kubernetes.io/projected/a08873b1-8408-4e7a-aa10-abfdb637b3c0-kube-api-access-gxn8j\") pod \"test-curl-7393-139986656743120\" (UID: \"a08873b1-8408-4e7a-aa10-abfdb637b3c0\") " pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:57.160667 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:57.160637    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:57.297126 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:57.295252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-139986656743120"]
Jul 20 14:25:57.300729 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:25:57.300705    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda08873b1_8408_4e7a_aa10_abfdb637b3c0.slice/crio-b67cfad7310db802828176ac8e04e3802433e12f63c0d4b9511c9581b609a709 WatchSource:0}: Error finding container b67cfad7310db802828176ac8e04e3802433e12f63c0d4b9511c9581b609a709: Status 404 returned error can't find the container with id b67cfad7310db802828176ac8e04e3802433e12f63c0d4b9511c9581b609a709
Jul 20 14:25:57.526142 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:57.526052    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986656743120" event={"ID":"a08873b1-8408-4e7a-aa10-abfdb637b3c0","Type":"ContainerStarted","Data":"b67cfad7310db802828176ac8e04e3802433e12f63c0d4b9511c9581b609a709"}
Jul 20 14:25:57.527221 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:57.527204    2563 scope.go:117] "RemoveContainer" containerID="ad344281adf88c60d60eb2ec161964be542dbb56c6c74336a7c62a9a33f28697"
Jul 20 14:25:57.527322 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:57.527245    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:58.453011 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:58.452966    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:25:58.533665 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:58.533629    2563 generic.go:356] "Generic (PLEG): container finished" podID="a08873b1-8408-4e7a-aa10-abfdb637b3c0" containerID="c6198d506174db8f7ae4d69dab191103162718e2cf83d815171f76cc5261dbfe" exitCode=0
Jul 20 14:25:58.533832 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:58.533693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986656743120" event={"ID":"a08873b1-8408-4e7a-aa10-abfdb637b3c0","Type":"ContainerDied","Data":"c6198d506174db8f7ae4d69dab191103162718e2cf83d815171f76cc5261dbfe"}
Jul 20 14:25:59.672870 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.672842    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:25:59.691430 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.691384    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7393-139986656743120_a08873b1-8408-4e7a-aa10-abfdb637b3c0/test-curl-7393-139986656743120/0.log"
Jul 20 14:25:59.714714 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.714680    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7393-139986656743120"]
Jul 20 14:25:59.718505 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.718480    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7393-139986656743120"]
Jul 20 14:25:59.720431 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.720394    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxn8j\" (UniqueName: \"kubernetes.io/projected/a08873b1-8408-4e7a-aa10-abfdb637b3c0-kube-api-access-gxn8j\") pod \"a08873b1-8408-4e7a-aa10-abfdb637b3c0\" (UID: \"a08873b1-8408-4e7a-aa10-abfdb637b3c0\") "
Jul 20 14:25:59.722527 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.722504    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a08873b1-8408-4e7a-aa10-abfdb637b3c0-kube-api-access-gxn8j" (OuterVolumeSpecName: "kube-api-access-gxn8j") pod "a08873b1-8408-4e7a-aa10-abfdb637b3c0" (UID: "a08873b1-8408-4e7a-aa10-abfdb637b3c0"). InnerVolumeSpecName "kube-api-access-gxn8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:25:59.821074 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.821042    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxn8j\" (UniqueName: \"kubernetes.io/projected/a08873b1-8408-4e7a-aa10-abfdb637b3c0-kube-api-access-gxn8j\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:25:59.843549 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.843512    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7393-139986656741392"]
Jul 20 14:25:59.843875 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.843858    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a08873b1-8408-4e7a-aa10-abfdb637b3c0" containerName="test-curl-7393-139986656743120"
Jul 20 14:25:59.843972 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.843878    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a08873b1-8408-4e7a-aa10-abfdb637b3c0" containerName="test-curl-7393-139986656743120"
Jul 20 14:25:59.843972 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.843963    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a08873b1-8408-4e7a-aa10-abfdb637b3c0" containerName="test-curl-7393-139986656743120"
Jul 20 14:25:59.846836 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.846813    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:25:59.853204 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.853179    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-139986656741392"]
Jul 20 14:25:59.921926 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:25:59.921890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h52sj\" (UniqueName: \"kubernetes.io/projected/9c2234db-8e07-4beb-9a7a-1e07ce7504c3-kube-api-access-h52sj\") pod \"test-curl-7393-139986656741392\" (UID: \"9c2234db-8e07-4beb-9a7a-1e07ce7504c3\") " pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:00.022936 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.022902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h52sj\" (UniqueName: \"kubernetes.io/projected/9c2234db-8e07-4beb-9a7a-1e07ce7504c3-kube-api-access-h52sj\") pod \"test-curl-7393-139986656741392\" (UID: \"9c2234db-8e07-4beb-9a7a-1e07ce7504c3\") " pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:00.031956 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.031926    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h52sj\" (UniqueName: \"kubernetes.io/projected/9c2234db-8e07-4beb-9a7a-1e07ce7504c3-kube-api-access-h52sj\") pod \"test-curl-7393-139986656741392\" (UID: \"9c2234db-8e07-4beb-9a7a-1e07ce7504c3\") " pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:00.156200 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.156106    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:00.286911 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.286890    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-139986656741392"]
Jul 20 14:26:00.290171 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:26:00.290139    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c2234db_8e07_4beb_9a7a_1e07ce7504c3.slice/crio-507f1007379e0c1b524b82fa234c0d0b9bed261c0f525620850bbd4695041fdb WatchSource:0}: Error finding container 507f1007379e0c1b524b82fa234c0d0b9bed261c0f525620850bbd4695041fdb: Status 404 returned error can't find the container with id 507f1007379e0c1b524b82fa234c0d0b9bed261c0f525620850bbd4695041fdb
Jul 20 14:26:00.295538 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.295504    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c" podUID="6ed8c77e-c6b3-48c6-94ab-4c31106d93d1" containerName="main" containerID="cri-o://d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3" gracePeriod=45
Jul 20 14:26:00.538945 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.538919    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:26:00.546763 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.546735    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:26:00.546900 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.546779    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b67cfad7310db802828176ac8e04e3802433e12f63c0d4b9511c9581b609a709"
Jul 20 14:26:00.547937 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.547908    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986656741392" event={"ID":"9c2234db-8e07-4beb-9a7a-1e07ce7504c3","Type":"ContainerStarted","Data":"507f1007379e0c1b524b82fa234c0d0b9bed261c0f525620850bbd4695041fdb"}
Jul 20 14:26:00.549059 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.549038    2563 generic.go:356] "Generic (PLEG): container finished" podID="6ed8c77e-c6b3-48c6-94ab-4c31106d93d1" containerID="d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3" exitCode=0
Jul 20 14:26:00.549162 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.549074    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"
Jul 20 14:26:00.549162 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.549122    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c" event={"ID":"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1","Type":"ContainerDied","Data":"d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3"}
Jul 20 14:26:00.549348 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.549163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c" event={"ID":"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1","Type":"ContainerDied","Data":"a93b2e5e1331bf106a83b018a101971265e77d8cf11eabeb34fdfe6a4aff0f46"}
Jul 20 14:26:00.549348 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.549187    2563 scope.go:117] "RemoveContainer" containerID="d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3"
Jul 20 14:26:00.559752 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.559729    2563 scope.go:117] "RemoveContainer" containerID="d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3"
Jul 20 14:26:00.560035 ip-10-0-134-120 kubenswrapper[2563]: E0720 14:26:00.560016    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3\": container with ID starting with d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3 not found: ID does not exist" containerID="d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3"
Jul 20 14:26:00.560094 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.560043    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3"} err="failed to get container status \"d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3\": rpc error: code = NotFound desc = could not find container \"d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3\": container with ID starting with d9a9a80e2d1d2153eb2fe280e054335bf8d6fa1586d4ca0f73d4b61d0f8ff8e3 not found: ID does not exist"
Jul 20 14:26:00.561322 ip-10-0-134-120 kubenswrapper[2563]: E0720 14:26:00.561296    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7393-139986656743120\" is forbidden: User \"system:node:ip-10-0-134-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-120.ec2.internal' and this object" podUID="a08873b1-8408-4e7a-aa10-abfdb637b3c0" pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:26:00.627607 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.627585    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-tmp-dir\") pod \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") "
Jul 20 14:26:00.627721 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.627616    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-home\") pod \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") "
Jul 20 14:26:00.627721 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.627677    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-dshm\") pod \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") "
Jul 20 14:26:00.627721 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.627694    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-model-cache\") pod \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") "
Jul 20 14:26:00.627721 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.627717    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmht2\" (UniqueName: \"kubernetes.io/projected/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-kube-api-access-cmht2\") pod \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") "
Jul 20 14:26:00.627924 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.627745    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-tls-certs\") pod \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\" (UID: \"6ed8c77e-c6b3-48c6-94ab-4c31106d93d1\") "
Jul 20 14:26:00.627924 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.627849    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ed8c77e-c6b3-48c6-94ab-4c31106d93d1" (UID: "6ed8c77e-c6b3-48c6-94ab-4c31106d93d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:00.628036 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.627957    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-home" (OuterVolumeSpecName: "home") pod "6ed8c77e-c6b3-48c6-94ab-4c31106d93d1" (UID: "6ed8c77e-c6b3-48c6-94ab-4c31106d93d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:00.628036 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.628017    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-tmp-dir\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:00.628036 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.628028    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-home\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:00.628260 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.628235    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ed8c77e-c6b3-48c6-94ab-4c31106d93d1" (UID: "6ed8c77e-c6b3-48c6-94ab-4c31106d93d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:00.630316 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.630289    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-dshm" (OuterVolumeSpecName: "dshm") pod "6ed8c77e-c6b3-48c6-94ab-4c31106d93d1" (UID: "6ed8c77e-c6b3-48c6-94ab-4c31106d93d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:00.630438 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.630399    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-kube-api-access-cmht2" (OuterVolumeSpecName: "kube-api-access-cmht2") pod "6ed8c77e-c6b3-48c6-94ab-4c31106d93d1" (UID: "6ed8c77e-c6b3-48c6-94ab-4c31106d93d1"). InnerVolumeSpecName "kube-api-access-cmht2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:26:00.630438 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.630394    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ed8c77e-c6b3-48c6-94ab-4c31106d93d1" (UID: "6ed8c77e-c6b3-48c6-94ab-4c31106d93d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:26:00.729446 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.729384    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-dshm\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:00.729446 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.729442    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-model-cache\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:00.729848 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.729457    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmht2\" (UniqueName: \"kubernetes.io/projected/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-kube-api-access-cmht2\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:00.729848 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.729470    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1-tls-certs\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:00.869548 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.869513    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"]
Jul 20 14:26:00.872624 ip-10-0-134-120 kubenswrapper[2563]: E0720 14:26:00.872585    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7393-139986656743120\" is forbidden: User \"system:node:ip-10-0-134-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-120.ec2.internal' and this object" podUID="a08873b1-8408-4e7a-aa10-abfdb637b3c0" pod="opendatahub/test-curl-7393-139986656743120"
Jul 20 14:26:00.873057 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.873037    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-57d0e8/rate-test-model-57d0e8-kserve-6df7cd55f5-td26c"]
Jul 20 14:26:00.946163 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.946086    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ed8c77e-c6b3-48c6-94ab-4c31106d93d1" path="/var/lib/kubelet/pods/6ed8c77e-c6b3-48c6-94ab-4c31106d93d1/volumes"
Jul 20 14:26:00.946432 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:00.946418    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a08873b1-8408-4e7a-aa10-abfdb637b3c0" path="/var/lib/kubelet/pods/a08873b1-8408-4e7a-aa10-abfdb637b3c0/volumes"
Jul 20 14:26:01.248773 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.248684    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9" podUID="9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" containerName="main" containerID="cri-o://d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a" gracePeriod=45
Jul 20 14:26:01.289934 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.289895    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9" podUID="9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": dial tcp 10.133.0.49:8000: connect: connection refused"
Jul 20 14:26:01.499692 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.499637    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:26:01.536602 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.536555    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-home\") pod \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") "
Jul 20 14:26:01.536602 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.536602    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-dshm\") pod \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") "
Jul 20 14:26:01.536851 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.536639    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-model-cache\") pod \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") "
Jul 20 14:26:01.536851 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.536686    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88xn5\" (UniqueName: \"kubernetes.io/projected/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-kube-api-access-88xn5\") pod \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") "
Jul 20 14:26:01.536851 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.536707    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-tls-certs\") pod \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") "
Jul 20 14:26:01.536851 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.536739    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-tmp-dir\") pod \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\" (UID: \"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c\") "
Jul 20 14:26:01.537068 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.536848    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-home" (OuterVolumeSpecName: "home") pod "9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" (UID: "9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:01.537068 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.536898    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-model-cache" (OuterVolumeSpecName: "model-cache") pod "9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" (UID: "9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:01.537068 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.536994    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-model-cache\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:01.537068 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.537013    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-home\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:01.537068 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.537018    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" (UID: "9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:01.539044 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.539017    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-kube-api-access-88xn5" (OuterVolumeSpecName: "kube-api-access-88xn5") pod "9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" (UID: "9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c"). InnerVolumeSpecName "kube-api-access-88xn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:26:01.539148 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.539042    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" (UID: "9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:26:01.539148 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.539067    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-dshm" (OuterVolumeSpecName: "dshm") pod "9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" (UID: "9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:01.555822 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.555798    2563 generic.go:356] "Generic (PLEG): container finished" podID="9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" containerID="d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a" exitCode=0
Jul 20 14:26:01.555929 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.555846    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9" event={"ID":"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c","Type":"ContainerDied","Data":"d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a"}
Jul 20 14:26:01.555929 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.555887    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9" event={"ID":"9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c","Type":"ContainerDied","Data":"05be38afe94f3853ffcdc726822a21f1a25c6b2092ba3aa916263adee5721a19"}
Jul 20 14:26:01.555929 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.555904    2563 scope.go:117] "RemoveContainer" containerID="d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a"
Jul 20 14:26:01.555929 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.555855    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"
Jul 20 14:26:01.557647 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.557623    2563 generic.go:356] "Generic (PLEG): container finished" podID="9c2234db-8e07-4beb-9a7a-1e07ce7504c3" containerID="36c2a9b82d3e2c0c77f4f60811d2e2ae310744d90da2cd1ccd828c49eac187fe" exitCode=0
Jul 20 14:26:01.557747 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.557684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986656741392" event={"ID":"9c2234db-8e07-4beb-9a7a-1e07ce7504c3","Type":"ContainerDied","Data":"36c2a9b82d3e2c0c77f4f60811d2e2ae310744d90da2cd1ccd828c49eac187fe"}
Jul 20 14:26:01.564707 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.564691    2563 scope.go:117] "RemoveContainer" containerID="d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a"
Jul 20 14:26:01.564957 ip-10-0-134-120 kubenswrapper[2563]: E0720 14:26:01.564940    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a\": container with ID starting with d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a not found: ID does not exist" containerID="d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a"
Jul 20 14:26:01.565025 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.564964    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a"} err="failed to get container status \"d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a\": rpc error: code = NotFound desc = could not find container \"d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a\": container with ID starting with d26144e908fb29e5a48c157db0b8fc6c88fc2515aa0b157615a4593a1d1f1e6a not found: ID does not exist"
Jul 20 14:26:01.587503 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.587303    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"]
Jul 20 14:26:01.589431 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.589393    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-424aa6/rate-test-model-424aa6-kserve-56d794b6c5-vp5j9"]
Jul 20 14:26:01.637673 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.637647    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88xn5\" (UniqueName: \"kubernetes.io/projected/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-kube-api-access-88xn5\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:01.637673 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.637671    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-tls-certs\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:01.637827 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.637681    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-tmp-dir\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:01.637827 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:01.637688    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c-dshm\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:02.693375 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.693351    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:02.712588 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.712544    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7393-139986656741392_9c2234db-8e07-4beb-9a7a-1e07ce7504c3/test-curl-7393-139986656741392/0.log"
Jul 20 14:26:02.736026 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.735999    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7393-139986656741392"]
Jul 20 14:26:02.739307 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.739283    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7393-139986656741392"]
Jul 20 14:26:02.745508 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.745483    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h52sj\" (UniqueName: \"kubernetes.io/projected/9c2234db-8e07-4beb-9a7a-1e07ce7504c3-kube-api-access-h52sj\") pod \"9c2234db-8e07-4beb-9a7a-1e07ce7504c3\" (UID: \"9c2234db-8e07-4beb-9a7a-1e07ce7504c3\") "
Jul 20 14:26:02.747703 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.747681    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c2234db-8e07-4beb-9a7a-1e07ce7504c3-kube-api-access-h52sj" (OuterVolumeSpecName: "kube-api-access-h52sj") pod "9c2234db-8e07-4beb-9a7a-1e07ce7504c3" (UID: "9c2234db-8e07-4beb-9a7a-1e07ce7504c3"). InnerVolumeSpecName "kube-api-access-h52sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:26:02.846200 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.846168    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h52sj\" (UniqueName: \"kubernetes.io/projected/9c2234db-8e07-4beb-9a7a-1e07ce7504c3-kube-api-access-h52sj\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:02.862522 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.862493    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7393-139986656741392"]
Jul 20 14:26:02.862808 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.862795    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" containerName="main"
Jul 20 14:26:02.862808 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.862808    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" containerName="main"
Jul 20 14:26:02.862893 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.862818    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c2234db-8e07-4beb-9a7a-1e07ce7504c3" containerName="test-curl-7393-139986656741392"
Jul 20 14:26:02.862893 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.862824    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c2234db-8e07-4beb-9a7a-1e07ce7504c3" containerName="test-curl-7393-139986656741392"
Jul 20 14:26:02.862893 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.862836    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed8c77e-c6b3-48c6-94ab-4c31106d93d1" containerName="main"
Jul 20 14:26:02.862893 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.862841    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed8c77e-c6b3-48c6-94ab-4c31106d93d1" containerName="main"
Jul 20 14:26:02.862893 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.862886    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed8c77e-c6b3-48c6-94ab-4c31106d93d1" containerName="main"
Jul 20 14:26:02.862893 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.862893    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" containerName="main"
Jul 20 14:26:02.863090 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.862899    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c2234db-8e07-4beb-9a7a-1e07ce7504c3" containerName="test-curl-7393-139986656741392"
Jul 20 14:26:02.865580 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.865564    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:02.871150 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.871124    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-139986656741392"]
Jul 20 14:26:02.945538 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.945507    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c2234db-8e07-4beb-9a7a-1e07ce7504c3" path="/var/lib/kubelet/pods/9c2234db-8e07-4beb-9a7a-1e07ce7504c3/volumes"
Jul 20 14:26:02.945882 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.945870    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c" path="/var/lib/kubelet/pods/9dde19ca-cbbc-48c4-9b96-a1b84ec2cb7c/volumes"
Jul 20 14:26:02.947238 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:02.947218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9jl8\" (UniqueName: \"kubernetes.io/projected/32a3deb3-2878-4479-a3c4-d4285fce1f60-kube-api-access-t9jl8\") pod \"test-curl-7393-139986656741392\" (UID: \"32a3deb3-2878-4479-a3c4-d4285fce1f60\") " pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:03.048038 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:03.048007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9jl8\" (UniqueName: \"kubernetes.io/projected/32a3deb3-2878-4479-a3c4-d4285fce1f60-kube-api-access-t9jl8\") pod \"test-curl-7393-139986656741392\" (UID: \"32a3deb3-2878-4479-a3c4-d4285fce1f60\") " pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:03.055869 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:03.055847    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9jl8\" (UniqueName: \"kubernetes.io/projected/32a3deb3-2878-4479-a3c4-d4285fce1f60-kube-api-access-t9jl8\") pod \"test-curl-7393-139986656741392\" (UID: \"32a3deb3-2878-4479-a3c4-d4285fce1f60\") " pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:03.175784 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:03.175701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:03.306533 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:03.306509    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-139986656741392"]
Jul 20 14:26:03.308212 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:26:03.308180    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32a3deb3_2878_4479_a3c4_d4285fce1f60.slice/crio-9012afaa5f35c01c053725542ce4c4f812d570d48b61ef0ff52944c32026a155 WatchSource:0}: Error finding container 9012afaa5f35c01c053725542ce4c4f812d570d48b61ef0ff52944c32026a155: Status 404 returned error can't find the container with id 9012afaa5f35c01c053725542ce4c4f812d570d48b61ef0ff52944c32026a155
Jul 20 14:26:03.571277 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:03.571236    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986656741392" event={"ID":"32a3deb3-2878-4479-a3c4-d4285fce1f60","Type":"ContainerStarted","Data":"9012afaa5f35c01c053725542ce4c4f812d570d48b61ef0ff52944c32026a155"}
Jul 20 14:26:03.572437 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:03.572392    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:03.572575 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:03.572439    2563 scope.go:117] "RemoveContainer" containerID="36c2a9b82d3e2c0c77f4f60811d2e2ae310744d90da2cd1ccd828c49eac187fe"
Jul 20 14:26:04.579850 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:04.579815    2563 generic.go:356] "Generic (PLEG): container finished" podID="32a3deb3-2878-4479-a3c4-d4285fce1f60" containerID="8fa9d6210a2dac2b274feeeca8520684e1c3c653ddd22f8dfbd18a2866cafe1b" exitCode=0
Jul 20 14:26:04.580273 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:04.579892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-139986656741392" event={"ID":"32a3deb3-2878-4479-a3c4-d4285fce1f60","Type":"ContainerDied","Data":"8fa9d6210a2dac2b274feeeca8520684e1c3c653ddd22f8dfbd18a2866cafe1b"}
Jul 20 14:26:05.719476 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.719451    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:05.739904 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.739875    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7393-139986656741392_32a3deb3-2878-4479-a3c4-d4285fce1f60/test-curl-7393-139986656741392/0.log"
Jul 20 14:26:05.768455 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.768419    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7393-139986656741392"]
Jul 20 14:26:05.769660 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.769636    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9jl8\" (UniqueName: \"kubernetes.io/projected/32a3deb3-2878-4479-a3c4-d4285fce1f60-kube-api-access-t9jl8\") pod \"32a3deb3-2878-4479-a3c4-d4285fce1f60\" (UID: \"32a3deb3-2878-4479-a3c4-d4285fce1f60\") "
Jul 20 14:26:05.771978 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.771954    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32a3deb3-2878-4479-a3c4-d4285fce1f60-kube-api-access-t9jl8" (OuterVolumeSpecName: "kube-api-access-t9jl8") pod "32a3deb3-2878-4479-a3c4-d4285fce1f60" (UID: "32a3deb3-2878-4479-a3c4-d4285fce1f60"). InnerVolumeSpecName "kube-api-access-t9jl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:26:05.772127 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.772104    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7393-139986656741392"]
Jul 20 14:26:05.870660 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.870570    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9jl8\" (UniqueName: \"kubernetes.io/projected/32a3deb3-2878-4479-a3c4-d4285fce1f60-kube-api-access-t9jl8\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:05.964001 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.963961    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn"]
Jul 20 14:26:05.964357 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.964340    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32a3deb3-2878-4479-a3c4-d4285fce1f60" containerName="test-curl-7393-139986656741392"
Jul 20 14:26:05.964471 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.964361    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="32a3deb3-2878-4479-a3c4-d4285fce1f60" containerName="test-curl-7393-139986656741392"
Jul 20 14:26:05.964527 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.964473    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="32a3deb3-2878-4479-a3c4-d4285fce1f60" containerName="test-curl-7393-139986656741392"
Jul 20 14:26:05.967422 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.967389    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn"
Jul 20 14:26:05.970776 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.970754    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 14:26:05.970857 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.970826    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:26:05.976469 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:05.976446    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn"]
Jul 20 14:26:06.071768 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:06.071727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c780ef-b27a-4972-a2b3-6c2666cf1669-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn\" (UID: \"98c780ef-b27a-4972-a2b3-6c2666cf1669\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn"
Jul 20 14:26:06.173187 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:06.173094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c780ef-b27a-4972-a2b3-6c2666cf1669-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn\" (UID: \"98c780ef-b27a-4972-a2b3-6c2666cf1669\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn"
Jul 20 14:26:06.173768 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:06.173748    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c780ef-b27a-4972-a2b3-6c2666cf1669-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn\" (UID: \"98c780ef-b27a-4972-a2b3-6c2666cf1669\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn"
Jul 20 14:26:06.278258 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:06.278221    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn"
Jul 20 14:26:06.413488 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:06.413431    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn"]
Jul 20 14:26:06.415855 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:26:06.415825    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c780ef_b27a_4972_a2b3_6c2666cf1669.slice/crio-1d437de9d05a10e35f26d7cffe7bbdcd685be31dcb5a5c66ed52b30a26164502 WatchSource:0}: Error finding container 1d437de9d05a10e35f26d7cffe7bbdcd685be31dcb5a5c66ed52b30a26164502: Status 404 returned error can't find the container with id 1d437de9d05a10e35f26d7cffe7bbdcd685be31dcb5a5c66ed52b30a26164502
Jul 20 14:26:06.592907 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:06.592870    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn" event={"ID":"98c780ef-b27a-4972-a2b3-6c2666cf1669","Type":"ContainerStarted","Data":"1d437de9d05a10e35f26d7cffe7bbdcd685be31dcb5a5c66ed52b30a26164502"}
Jul 20 14:26:06.594165 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:06.594140    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9012afaa5f35c01c053725542ce4c4f812d570d48b61ef0ff52944c32026a155"
Jul 20 14:26:06.594282 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:06.594182    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:06.615289 ip-10-0-134-120 kubenswrapper[2563]: E0720 14:26:06.615259    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7393-139986656741392\" is forbidden: User \"system:node:ip-10-0-134-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-120.ec2.internal' and this object" podUID="32a3deb3-2878-4479-a3c4-d4285fce1f60" pod="opendatahub/test-curl-7393-139986656741392"
Jul 20 14:26:06.945995 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:06.945963    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32a3deb3-2878-4479-a3c4-d4285fce1f60" path="/var/lib/kubelet/pods/32a3deb3-2878-4479-a3c4-d4285fce1f60/volumes"
Jul 20 14:26:07.604340 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:07.604304    2563 generic.go:356] "Generic (PLEG): container finished" podID="98c780ef-b27a-4972-a2b3-6c2666cf1669" containerID="52a8f470e79065dedad787b4dd6fec8c617d955a065597ec6cf5ad7452fe30e7" exitCode=0
Jul 20 14:26:07.604564 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:07.604387    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn" event={"ID":"98c780ef-b27a-4972-a2b3-6c2666cf1669","Type":"ContainerDied","Data":"52a8f470e79065dedad787b4dd6fec8c617d955a065597ec6cf5ad7452fe30e7"}
Jul 20 14:26:08.743092 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:08.743064    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn"
Jul 20 14:26:08.796720 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:08.796678    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c780ef-b27a-4972-a2b3-6c2666cf1669-maas-api-service-ca\") pod \"98c780ef-b27a-4972-a2b3-6c2666cf1669\" (UID: \"98c780ef-b27a-4972-a2b3-6c2666cf1669\") "
Jul 20 14:26:08.797049 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:08.797026    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98c780ef-b27a-4972-a2b3-6c2666cf1669-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "98c780ef-b27a-4972-a2b3-6c2666cf1669" (UID: "98c780ef-b27a-4972-a2b3-6c2666cf1669"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:26:08.898253 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:08.898164    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c780ef-b27a-4972-a2b3-6c2666cf1669-maas-api-service-ca\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:09.616306 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:09.616277    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn"
Jul 20 14:26:09.616548 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:09.616317    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn" event={"ID":"98c780ef-b27a-4972-a2b3-6c2666cf1669","Type":"ContainerDied","Data":"1d437de9d05a10e35f26d7cffe7bbdcd685be31dcb5a5c66ed52b30a26164502"}
Jul 20 14:26:09.616548 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:09.616363    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d437de9d05a10e35f26d7cffe7bbdcd685be31dcb5a5c66ed52b30a26164502"
Jul 20 14:26:19.949662 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:19.949580    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:26:21.052074 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:21.052031    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn"]
Jul 20 14:26:21.055328 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:21.055300    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-57d0e8-422qn"]
Jul 20 14:26:22.945936 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:22.945900    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98c780ef-b27a-4972-a2b3-6c2666cf1669" path="/var/lib/kubelet/pods/98c780ef-b27a-4972-a2b3-6c2666cf1669/volumes"
Jul 20 14:26:28.014146 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.014110    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq"]
Jul 20 14:26:28.014560 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.014416    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98c780ef-b27a-4972-a2b3-6c2666cf1669" containerName="revoke-keys"
Jul 20 14:26:28.014560 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.014426    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98c780ef-b27a-4972-a2b3-6c2666cf1669" containerName="revoke-keys"
Jul 20 14:26:28.014560 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.014478    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98c780ef-b27a-4972-a2b3-6c2666cf1669" containerName="revoke-keys"
Jul 20 14:26:28.019559 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.019539    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq"
Jul 20 14:26:28.022398 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.022373    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 14:26:28.023272 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.022818    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:26:28.024904 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.024847    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq"]
Jul 20 14:26:28.161575 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.161535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f890cbfc-3a57-455d-af12-9cc201b70489-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq\" (UID: \"f890cbfc-3a57-455d-af12-9cc201b70489\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq"
Jul 20 14:26:28.262790 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.262754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f890cbfc-3a57-455d-af12-9cc201b70489-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq\" (UID: \"f890cbfc-3a57-455d-af12-9cc201b70489\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq"
Jul 20 14:26:28.263373 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.263352    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f890cbfc-3a57-455d-af12-9cc201b70489-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq\" (UID: \"f890cbfc-3a57-455d-af12-9cc201b70489\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq"
Jul 20 14:26:28.331135 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.331106    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq"
Jul 20 14:26:28.464995 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.464902    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq"]
Jul 20 14:26:28.467155 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:26:28.467130    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf890cbfc_3a57_455d_af12_9cc201b70489.slice/crio-662a104700d0f714cfdd54be7e51dce8db9496baf49ca41da22caa3757f68822 WatchSource:0}: Error finding container 662a104700d0f714cfdd54be7e51dce8db9496baf49ca41da22caa3757f68822: Status 404 returned error can't find the container with id 662a104700d0f714cfdd54be7e51dce8db9496baf49ca41da22caa3757f68822
Jul 20 14:26:28.708007 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:28.707928    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq" event={"ID":"f890cbfc-3a57-455d-af12-9cc201b70489","Type":"ContainerStarted","Data":"662a104700d0f714cfdd54be7e51dce8db9496baf49ca41da22caa3757f68822"}
Jul 20 14:26:29.713924 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:29.713892    2563 generic.go:356] "Generic (PLEG): container finished" podID="f890cbfc-3a57-455d-af12-9cc201b70489" containerID="903dc0a8d7cd673144b79c296ee7b103b0016f6e97939e06eb15a03bdf50c469" exitCode=0
Jul 20 14:26:29.714327 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:29.713973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq" event={"ID":"f890cbfc-3a57-455d-af12-9cc201b70489","Type":"ContainerDied","Data":"903dc0a8d7cd673144b79c296ee7b103b0016f6e97939e06eb15a03bdf50c469"}
Jul 20 14:26:30.856325 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:30.856299    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq"
Jul 20 14:26:30.986475 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:30.986375    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f890cbfc-3a57-455d-af12-9cc201b70489-maas-api-service-ca\") pod \"f890cbfc-3a57-455d-af12-9cc201b70489\" (UID: \"f890cbfc-3a57-455d-af12-9cc201b70489\") "
Jul 20 14:26:30.986708 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:30.986686    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f890cbfc-3a57-455d-af12-9cc201b70489-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f890cbfc-3a57-455d-af12-9cc201b70489" (UID: "f890cbfc-3a57-455d-af12-9cc201b70489"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:26:31.087521 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:31.087485    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f890cbfc-3a57-455d-af12-9cc201b70489-maas-api-service-ca\") on node \"ip-10-0-134-120.ec2.internal\" DevicePath \"\""
Jul 20 14:26:31.724857 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:31.724828    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq"
Jul 20 14:26:31.724857 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:31.724852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq" event={"ID":"f890cbfc-3a57-455d-af12-9cc201b70489","Type":"ContainerDied","Data":"662a104700d0f714cfdd54be7e51dce8db9496baf49ca41da22caa3757f68822"}
Jul 20 14:26:31.725073 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:31.724918    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="662a104700d0f714cfdd54be7e51dce8db9496baf49ca41da22caa3757f68822"
Jul 20 14:26:41.597713 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:41.597677    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mdpwf"]
Jul 20 14:26:43.093254 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:43.093221    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq"]
Jul 20 14:26:43.095034 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:43.095013    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-424aa6-7jhzq"]
Jul 20 14:26:44.945393 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:44.945363    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f890cbfc-3a57-455d-af12-9cc201b70489" path="/var/lib/kubelet/pods/f890cbfc-3a57-455d-af12-9cc201b70489/volumes"
Jul 20 14:26:50.309022 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:50.308986    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85d6c4b4cc-szbgv_ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa/authorino/0.log"
Jul 20 14:26:56.591881 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:56.591852    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-26xpb_5a67b31e-7ed0-429c-ba74-917addd7ab3a/server/0.log"
Jul 20 14:26:56.715499 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:56.715472    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-z4kmf_75228171-e3fa-4278-bf73-63c66b43069d/manager/0.log"
Jul 20 14:26:56.842922 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:56.842849    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b98c56445-6qt7q_d9463dde-c44b-4f82-b0d5-abb1f197c81f/copy-manifests/0.log"
Jul 20 14:26:56.855818 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:56.855793    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b98c56445-6qt7q_d9463dde-c44b-4f82-b0d5-abb1f197c81f/manager/0.log"
Jul 20 14:26:57.758589 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:57.758556    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742615-qgwjw_4e078e68-4104-4cad-852a-6c9d7b4e9e0f/cleanup/0.log"
Jul 20 14:26:58.755759 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:58.755723    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj_8f6e7f0d-ab74-4739-90cb-d45d895f0927/util/0.log"
Jul 20 14:26:58.762461 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:58.762430    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj_8f6e7f0d-ab74-4739-90cb-d45d895f0927/pull/0.log"
Jul 20 14:26:58.768684 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:58.768666    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj_8f6e7f0d-ab74-4739-90cb-d45d895f0927/extract/0.log"
Jul 20 14:26:58.887596 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:58.887567    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b_c6e0a6c3-135c-46dd-9097-eb2ac742659f/util/0.log"
Jul 20 14:26:58.894487 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:58.894466    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b_c6e0a6c3-135c-46dd-9097-eb2ac742659f/pull/0.log"
Jul 20 14:26:58.901657 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:58.901639    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b_c6e0a6c3-135c-46dd-9097-eb2ac742659f/extract/0.log"
Jul 20 14:26:59.028878 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:59.028802    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t_33a5a356-a65e-4073-860f-7c1a5d82c214/util/0.log"
Jul 20 14:26:59.035859 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:59.035841    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t_33a5a356-a65e-4073-860f-7c1a5d82c214/pull/0.log"
Jul 20 14:26:59.042734 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:59.042716    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t_33a5a356-a65e-4073-860f-7c1a5d82c214/extract/0.log"
Jul 20 14:26:59.165010 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:59.164973    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t_5b93db6f-8c64-469e-8e8f-bb9cd074ba62/util/0.log"
Jul 20 14:26:59.171419 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:59.171391    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t_5b93db6f-8c64-469e-8e8f-bb9cd074ba62/pull/0.log"
Jul 20 14:26:59.177989 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:59.177973    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t_5b93db6f-8c64-469e-8e8f-bb9cd074ba62/extract/0.log"
Jul 20 14:26:59.310449 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:26:59.310340    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85d6c4b4cc-szbgv_ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa/authorino/0.log"
Jul 20 14:27:00.123848 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:00.123822    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mdpwf_fc9a8824-a161-4494-9da6-ac3791937918/limitador/0.log"
Jul 20 14:27:00.902379 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:00.902343    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8667c86565-fpxkz_21fc6bd7-3f3b-4148-bfda-6e296ea13475/kube-auth-proxy/0.log"
Jul 20 14:27:01.598784 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:01.598758    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b8c44bb68-lvpx2_c6f83af7-0503-42b5-9830-9a70124e5cda/router/0.log"
Jul 20 14:27:08.621926 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.621881    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mzrc5/must-gather-b8xkf"]
Jul 20 14:27:08.622439 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.622343    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f890cbfc-3a57-455d-af12-9cc201b70489" containerName="revoke-keys"
Jul 20 14:27:08.622439 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.622360    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f890cbfc-3a57-455d-af12-9cc201b70489" containerName="revoke-keys"
Jul 20 14:27:08.622573 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.622468    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f890cbfc-3a57-455d-af12-9cc201b70489" containerName="revoke-keys"
Jul 20 14:27:08.625538 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.625516    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzrc5/must-gather-b8xkf"
Jul 20 14:27:08.627981 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.627958    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mzrc5\"/\"kube-root-ca.crt\""
Jul 20 14:27:08.628095 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.627995    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mzrc5\"/\"openshift-service-ca.crt\""
Jul 20 14:27:08.628095 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.628013    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mzrc5\"/\"default-dockercfg-w8slk\""
Jul 20 14:27:08.636805 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.636781    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzrc5/must-gather-b8xkf"]
Jul 20 14:27:08.678092 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.678058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/558444ec-7cbd-47f1-a841-d67987be15c0-must-gather-output\") pod \"must-gather-b8xkf\" (UID: \"558444ec-7cbd-47f1-a841-d67987be15c0\") " pod="openshift-must-gather-mzrc5/must-gather-b8xkf"
Jul 20 14:27:08.678092 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.678095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk76z\" (UniqueName: \"kubernetes.io/projected/558444ec-7cbd-47f1-a841-d67987be15c0-kube-api-access-fk76z\") pod \"must-gather-b8xkf\" (UID: \"558444ec-7cbd-47f1-a841-d67987be15c0\") " pod="openshift-must-gather-mzrc5/must-gather-b8xkf"
Jul 20 14:27:08.779295 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.779260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/558444ec-7cbd-47f1-a841-d67987be15c0-must-gather-output\") pod \"must-gather-b8xkf\" (UID: \"558444ec-7cbd-47f1-a841-d67987be15c0\") " pod="openshift-must-gather-mzrc5/must-gather-b8xkf"
Jul 20 14:27:08.779295 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.779296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk76z\" (UniqueName: \"kubernetes.io/projected/558444ec-7cbd-47f1-a841-d67987be15c0-kube-api-access-fk76z\") pod \"must-gather-b8xkf\" (UID: \"558444ec-7cbd-47f1-a841-d67987be15c0\") " pod="openshift-must-gather-mzrc5/must-gather-b8xkf"
Jul 20 14:27:08.779687 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.779667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/558444ec-7cbd-47f1-a841-d67987be15c0-must-gather-output\") pod \"must-gather-b8xkf\" (UID: \"558444ec-7cbd-47f1-a841-d67987be15c0\") " pod="openshift-must-gather-mzrc5/must-gather-b8xkf"
Jul 20 14:27:08.790736 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.790714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk76z\" (UniqueName: \"kubernetes.io/projected/558444ec-7cbd-47f1-a841-d67987be15c0-kube-api-access-fk76z\") pod \"must-gather-b8xkf\" (UID: \"558444ec-7cbd-47f1-a841-d67987be15c0\") " pod="openshift-must-gather-mzrc5/must-gather-b8xkf"
Jul 20 14:27:08.935582 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:08.935490    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzrc5/must-gather-b8xkf"
Jul 20 14:27:09.093904 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:09.093873    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzrc5/must-gather-b8xkf"]
Jul 20 14:27:09.094492 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:27:09.094469    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod558444ec_7cbd_47f1_a841_d67987be15c0.slice/crio-b115644ed13661fdcccf53e0acb7f66e4754892fb8470f0ab4c8ab8efa89f09c WatchSource:0}: Error finding container b115644ed13661fdcccf53e0acb7f66e4754892fb8470f0ab4c8ab8efa89f09c: Status 404 returned error can't find the container with id b115644ed13661fdcccf53e0acb7f66e4754892fb8470f0ab4c8ab8efa89f09c
Jul 20 14:27:09.907501 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:09.907464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzrc5/must-gather-b8xkf" event={"ID":"558444ec-7cbd-47f1-a841-d67987be15c0","Type":"ContainerStarted","Data":"b115644ed13661fdcccf53e0acb7f66e4754892fb8470f0ab4c8ab8efa89f09c"}
Jul 20 14:27:10.915745 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:10.915706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzrc5/must-gather-b8xkf" event={"ID":"558444ec-7cbd-47f1-a841-d67987be15c0","Type":"ContainerStarted","Data":"15579e7fd465b04d0460036b966a93e0b4c71bf1a5816eb26bc65f179062c823"}
Jul 20 14:27:10.916228 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:10.915767    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzrc5/must-gather-b8xkf" event={"ID":"558444ec-7cbd-47f1-a841-d67987be15c0","Type":"ContainerStarted","Data":"2de0ded2977f71394c6dd35b7baf23b73475856887e761369cf169e1e42c636e"}
Jul 20 14:27:10.935325 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:10.935273    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mzrc5/must-gather-b8xkf" podStartSLOduration=1.937774996 podStartE2EDuration="2.935256071s" totalImagesPullingTime="997.481075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:27:10.933618882 +0000 UTC m=+2922.481190292" watchObservedRunningTime="2026-07-20 14:27:10.935256071 +0000 UTC m=+2922.482827456"
Jul 20 14:27:11.815596 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:11.815565    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-82vx5_12aecb57-1243-492c-9f94-cadbcafa4b5f/global-pull-secret-syncer/0.log"
Jul 20 14:27:12.012210 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:12.012173    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z9m75_6af5b675-8ee7-4c41-9e90-6497f9c3e88d/konnectivity-agent/0.log"
Jul 20 14:27:12.115254 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:12.115219    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-120.ec2.internal_90da8d909eb6fafa78270e85990e7272/haproxy/0.log"
Jul 20 14:27:15.968268 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:15.968240    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj_8f6e7f0d-ab74-4739-90cb-d45d895f0927/extract/0.log"
Jul 20 14:27:16.001020 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:16.000993    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj_8f6e7f0d-ab74-4739-90cb-d45d895f0927/util/0.log"
Jul 20 14:27:16.030538 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:16.030506    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kvplj_8f6e7f0d-ab74-4739-90cb-d45d895f0927/pull/0.log"
Jul 20 14:27:16.072332 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:16.072250    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b_c6e0a6c3-135c-46dd-9097-eb2ac742659f/extract/0.log"
Jul 20 14:27:16.096314 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:16.096284    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b_c6e0a6c3-135c-46dd-9097-eb2ac742659f/util/0.log"
Jul 20 14:27:16.127241 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:16.127209    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08tm5b_c6e0a6c3-135c-46dd-9097-eb2ac742659f/pull/0.log"
Jul 20 14:27:16.160286 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:16.160252    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t_33a5a356-a65e-4073-860f-7c1a5d82c214/extract/0.log"
Jul 20 14:27:16.197461 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:16.197398    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t_33a5a356-a65e-4073-860f-7c1a5d82c214/util/0.log"
Jul 20 14:27:16.232172 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:16.232071    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732288t_33a5a356-a65e-4073-860f-7c1a5d82c214/pull/0.log"
Jul 20 14:27:16.266525 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:16.266470    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t_5b93db6f-8c64-469e-8e8f-bb9cd074ba62/extract/0.log"
Jul 20 14:27:16.298300 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:16.298270    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t_5b93db6f-8c64-469e-8e8f-bb9cd074ba62/util/0.log"
Jul 20 14:27:16.339049 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:16.338992    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18gl6t_5b93db6f-8c64-469e-8e8f-bb9cd074ba62/pull/0.log"
Jul 20 14:27:16.822826 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:16.822778    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85d6c4b4cc-szbgv_ba5b3ad9-d324-4150-8c9d-b4adcf0aedfa/authorino/0.log"
Jul 20 14:27:17.258081 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:17.258004    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mdpwf_fc9a8824-a161-4494-9da6-ac3791937918/limitador/0.log"
Jul 20 14:27:19.307250 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:19.307169    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-jw9tp_894292f8-8752-466b-bab4-87a2d01ec6f4/cluster-monitoring-operator/0.log"
Jul 20 14:27:19.776758 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:19.776696    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zz728_acf60d30-1040-43bc-8ee7-358ae42ae640/node-exporter/0.log"
Jul 20 14:27:19.810829 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:19.810784    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zz728_acf60d30-1040-43bc-8ee7-358ae42ae640/kube-rbac-proxy/0.log"
Jul 20 14:27:19.837301 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:19.837273    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zz728_acf60d30-1040-43bc-8ee7-358ae42ae640/init-textfile/0.log"
Jul 20 14:27:22.464396 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.464354    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"]
Jul 20 14:27:22.470130 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.470093    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.478181 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.478151    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"]
Jul 20 14:27:22.507933 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.507898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d71463cb-3e9f-444b-bcbb-f25c2e92df31-podres\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.508190 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.508171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d71463cb-3e9f-444b-bcbb-f25c2e92df31-sys\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.508382 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.508365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d71463cb-3e9f-444b-bcbb-f25c2e92df31-lib-modules\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.508541 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.508527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d71463cb-3e9f-444b-bcbb-f25c2e92df31-proc\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.508672 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.508657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jbgf\" (UniqueName: \"kubernetes.io/projected/d71463cb-3e9f-444b-bcbb-f25c2e92df31-kube-api-access-5jbgf\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.609277 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.609232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d71463cb-3e9f-444b-bcbb-f25c2e92df31-lib-modules\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.609508 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.609289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d71463cb-3e9f-444b-bcbb-f25c2e92df31-proc\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.609508 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.609316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jbgf\" (UniqueName: \"kubernetes.io/projected/d71463cb-3e9f-444b-bcbb-f25c2e92df31-kube-api-access-5jbgf\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.609508 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.609376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d71463cb-3e9f-444b-bcbb-f25c2e92df31-podres\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.609508 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.609420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d71463cb-3e9f-444b-bcbb-f25c2e92df31-sys\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.609722 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.609506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d71463cb-3e9f-444b-bcbb-f25c2e92df31-lib-modules\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.609722 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.609533    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d71463cb-3e9f-444b-bcbb-f25c2e92df31-sys\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.609722 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.609635    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d71463cb-3e9f-444b-bcbb-f25c2e92df31-podres\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.609722 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.609684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d71463cb-3e9f-444b-bcbb-f25c2e92df31-proc\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.618627 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.618585    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jbgf\" (UniqueName: \"kubernetes.io/projected/d71463cb-3e9f-444b-bcbb-f25c2e92df31-kube-api-access-5jbgf\") pod \"perf-node-gather-daemonset-sgph6\" (UID: \"d71463cb-3e9f-444b-bcbb-f25c2e92df31\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.787240 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.787151    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:22.967641 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.967084    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"]
Jul 20 14:27:22.972192 ip-10-0-134-120 kubenswrapper[2563]: W0720 14:27:22.971901    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd71463cb_3e9f_444b_bcbb_f25c2e92df31.slice/crio-76599c47603f9a5d53d83ea26ea55366247075be87690852897f7b77338a3785 WatchSource:0}: Error finding container 76599c47603f9a5d53d83ea26ea55366247075be87690852897f7b77338a3785: Status 404 returned error can't find the container with id 76599c47603f9a5d53d83ea26ea55366247075be87690852897f7b77338a3785
Jul 20 14:27:22.984808 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:22.984784    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-z7cgr_07f18032-c55c-4731-9383-03487b0b0193/download-server/0.log"
Jul 20 14:27:23.025233 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:23.025193    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6" event={"ID":"d71463cb-3e9f-444b-bcbb-f25c2e92df31","Type":"ContainerStarted","Data":"76599c47603f9a5d53d83ea26ea55366247075be87690852897f7b77338a3785"}
Jul 20 14:27:24.033257 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:24.033214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6" event={"ID":"d71463cb-3e9f-444b-bcbb-f25c2e92df31","Type":"ContainerStarted","Data":"8fa7ffe12e939f679584c21a9904e1f331ea516ea0fb63e57210d9cb70b46fd9"}
Jul 20 14:27:24.033678 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:24.033374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:24.049097 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:24.049048    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6" podStartSLOduration=2.049031448 podStartE2EDuration="2.049031448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 14:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:27:24.047795242 +0000 UTC m=+2935.595366620" watchObservedRunningTime="2026-07-20 14:27:24.049031448 +0000 UTC m=+2935.596603223"
Jul 20 14:27:24.750130 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:24.750099    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rpjrt_68723171-55ad-486f-9630-cf1ac6b48c5d/dns/0.log"
Jul 20 14:27:24.777204 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:24.777170    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rpjrt_68723171-55ad-486f-9630-cf1ac6b48c5d/kube-rbac-proxy/0.log"
Jul 20 14:27:24.809981 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:24.809952    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mbgg_0f556d50-37cb-4f6f-ab10-28f4b5e4318d/dns-node-resolver/0.log"
Jul 20 14:27:25.445248 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:25.445206    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c97959959-fclsl_e736f60b-cac2-44b5-a288-8c8f58668aa8/registry/0.log"
Jul 20 14:27:25.468967 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:25.468942    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lr5ls_beb433e1-340e-4e3d-bced-322403fe86c9/node-ca/0.log"
Jul 20 14:27:26.644889 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:26.644863    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8667c86565-fpxkz_21fc6bd7-3f3b-4148-bfda-6e296ea13475/kube-auth-proxy/0.log"
Jul 20 14:27:26.826892 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:26.826854    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b8c44bb68-lvpx2_c6f83af7-0503-42b5-9830-9a70124e5cda/router/0.log"
Jul 20 14:27:27.547827 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:27.547798    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nslcs_612d1abb-56c1-4cde-be96-56c80194c8df/serve-healthcheck-canary/0.log"
Jul 20 14:27:28.142856 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:28.142829    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9l6hd_a5655a72-6305-49d9-a2c1-04ebcd96660b/kube-rbac-proxy/0.log"
Jul 20 14:27:28.177859 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:28.177825    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9l6hd_a5655a72-6305-49d9-a2c1-04ebcd96660b/exporter/0.log"
Jul 20 14:27:28.204670 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:28.204640    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9l6hd_a5655a72-6305-49d9-a2c1-04ebcd96660b/extractor/0.log"
Jul 20 14:27:30.052801 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:30.052764    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-sgph6"
Jul 20 14:27:31.080896 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:31.080841    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-26xpb_5a67b31e-7ed0-429c-ba74-917addd7ab3a/server/0.log"
Jul 20 14:27:31.211164 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:31.211122    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-z4kmf_75228171-e3fa-4278-bf73-63c66b43069d/manager/0.log"
Jul 20 14:27:31.311490 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:31.311397    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b98c56445-6qt7q_d9463dde-c44b-4f82-b0d5-abb1f197c81f/manager/0.log"
Jul 20 14:27:31.331668 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:31.331593    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b98c56445-6qt7q_d9463dde-c44b-4f82-b0d5-abb1f197c81f/copy-manifests/0.log"
Jul 20 14:27:32.875131 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:32.875061    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d5f789bb4-66mjq_6aae345e-9b99-4801-8731-dd15047bd1e9/manager/0.log"
Jul 20 14:27:32.883365 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:32.883344    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8667c86565-fpxkz_21fc6bd7-3f3b-4148-bfda-6e296ea13475/kube-auth-proxy/0.log"
Jul 20 14:27:33.027239 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:33.027210    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b8c44bb68-lvpx2_c6f83af7-0503-42b5-9830-9a70124e5cda/router/0.log"
Jul 20 14:27:34.490586 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:34.490552    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8667c86565-fpxkz_21fc6bd7-3f3b-4148-bfda-6e296ea13475/kube-auth-proxy/0.log"
Jul 20 14:27:34.646247 ip-10-0-134-120 kubenswrapper[2563]: I0720 14:27:34.646183    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b8c44bb68-lvpx2_c6f83af7-0503-42b5-9830-9a70124e5cda/router/0.log"