Jul 15 19:54:22.255233 ip-10-0-135-197 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 19:54:22.621842 ip-10-0-135-197 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:54:22.621842 ip-10-0-135-197 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 19:54:22.621842 ip-10-0-135-197 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:54:22.622661 ip-10-0-135-197 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 19:54:22.622661 ip-10-0-135-197 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:54:22.626417 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.626330    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 19:54:22.629775 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629761    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:54:22.629775 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629776    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629780    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629783    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629786    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629789    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629791    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629794    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629796    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629799    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629801    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629804    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629806    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629809    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629811    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629814    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629816    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629819    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629821    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629824    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629826    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:54:22.629838 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629829    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629831    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629833    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629836    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629838    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629841    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629843    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629846    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629855    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629858    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629860    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629863    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629866    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629868    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629871    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629873    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629876    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629879    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629882    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629885    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:54:22.630314 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629887    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629890    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629892    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629895    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629897    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629899    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629901    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629904    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629906    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629909    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629912    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629914    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629916    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629919    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629922    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629925    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629927    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629930    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629945    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629948    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:54:22.630788 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629952    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629954    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629957    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629962    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629966    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629968    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629971    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629974    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629976    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629979    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629981    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629984    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629986    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629989    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629991    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629995    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.629998    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630002    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630006    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:54:22.631307 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630009    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630013    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630015    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630018    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630021    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630023    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630026    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630029    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630032    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630035    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630037    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630040    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630042    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630045    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630047    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630050    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630052    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630055    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630057    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:54:22.631757 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630727    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630733    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630736    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630739    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630743    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630747    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630750    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630753    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630755    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630758    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630761    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630763    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630766    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630768    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630771    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630774    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630776    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630779    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630781    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:54:22.632267 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630783    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630787    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630790    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630794    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630798    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630801    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630804    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630807    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630809    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630812    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630815    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630817    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630819    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630822    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630824    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630827    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630829    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630832    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630835    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630837    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:54:22.632826 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630840    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630842    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630845    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630847    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630850    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630852    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630854    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630857    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630860    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630863    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630865    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630868    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630870    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630873    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630876    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630878    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630881    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630883    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630885    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630888    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:54:22.633356 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630891    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630893    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630895    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630898    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630900    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630903    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630905    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630907    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630910    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630912    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630915    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630917    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630920    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630922    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630925    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630927    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630929    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630949    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630952    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630954    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:54:22.633850 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630956    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630959    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630962    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630965    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630967    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630970    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630973    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630976    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630978    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630981    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630984    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630986    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630988    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630991    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630993    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630996    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.630998    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631002    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631006    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631009    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:54:22.634353 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631364    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631369    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631372    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631375    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631377    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631380    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631382    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631385    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631388    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631391    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631393    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631396    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631398    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631402    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631404    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631407    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631409    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631412    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631415    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631417    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:54:22.634846 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631420    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631422    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631425    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631427    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631430    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631432    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631435    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631439    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631442    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631445    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631448    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631451    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631453    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631458    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631462    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631465    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631468    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631471    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:54:22.635336 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631474    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631477    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631481    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631484    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631487    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631489    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631492    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631494    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631497    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631500    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631503    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631505    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631508    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631510    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631513    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631515    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631518    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631520    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631522    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631525    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:54:22.635771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631528    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631530    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631533    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631535    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631537    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631540    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631542    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631545    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631549    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631551    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631554    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631556    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631558    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631561    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631565    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631568    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631570    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631572    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631575    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631577    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:54:22.636275 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631580    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631583    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631586    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631588    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631591    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631593    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631595    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631598    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631600    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631603    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631605    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631607    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631610    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631612    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631614    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631617    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631619    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631622    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631624    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631626    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:54:22.636746 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.631628    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631694    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631701    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631708    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631712    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631716    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631721    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631724    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631729    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631732    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631735    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631738    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631741    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631744    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631748    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631751    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631753    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631756    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631760    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631763    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631767    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631770    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631773    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631776    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 19:54:22.637228 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631779    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631782    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631785    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631788    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631791    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631794    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631796    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631799    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631802    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631806    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631808    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631811    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631814    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631816    2560 flags.go:64] FLAG: --enable-server="true"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631819    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631824    2560 flags.go:64] FLAG: --event-burst="100"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631826    2560 flags.go:64] FLAG: --event-qps="50"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631829    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631832    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631835    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631838    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631840    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631844    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631847    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631850    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 19:54:22.637788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631853    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631856    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631858    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631861    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631864    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631866    2560 flags.go:64] FLAG: --feature-gates=""
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631870    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631873    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631875    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631878    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631881    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631884    2560 flags.go:64] FLAG: --help="false"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631886    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-135-197.ec2.internal"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631889    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631892    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631895    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631898    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631901    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631904    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631907    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631909    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631912    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631915    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631918    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 19:54:22.638466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631921    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631923    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631926    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631963    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631967    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631973    2560 flags.go:64] FLAG: --lock-file=""
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631976    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631979    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631982    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631987    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631990    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631993    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631996    2560 flags.go:64] FLAG: --logging-format="text"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.631998    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632002    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632004    2560 flags.go:64] FLAG: --manifest-url=""
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632007    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632011    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632014    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632018    2560 flags.go:64] FLAG: --max-pods="110"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632020    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632023    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632026    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632029    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632032    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 19:54:22.639090 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632035    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632037    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632044    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632047    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632050    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632053    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632056    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632061    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632065    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632068    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632070    2560 flags.go:64] FLAG: --port="10250"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632073    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632076    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06ddc158d07837fb4"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632081    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632084    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632087    2560 flags.go:64] FLAG: --register-node="true"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632090    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632093    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632096    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632099    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632101    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632105    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632108    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632110    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632113    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 19:54:22.639700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632116    2560 flags.go:64] FLAG: --runonce="false"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632119    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632121    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632124    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632127    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632130    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632132    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632135    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632138    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632141    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632144    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632147    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632150    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632153    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632155    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632158    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632163    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632165    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632168    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632172    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632175    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632178    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632181    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632184    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632187    2560 flags.go:64] FLAG: --v="2"
Jul 15 19:54:22.640338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632191    2560 flags.go:64] FLAG: --version="false"
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632194    2560 flags.go:64] FLAG: --vmodule=""
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632198    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.632201    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632316    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632321    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632324    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632327    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632329    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632332    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632335    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632338    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632341    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632343    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632346    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632349    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632351    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632354    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632358    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632360    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632363    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:54:22.640966 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632365    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632368    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632370    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632373    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632375    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632378    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632382    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632384    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632387    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632389    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632392    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632395    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632398    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632400    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632403    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632405    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632408    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632410    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632412    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632415    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:54:22.641473 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632417    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632420    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632422    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632425    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632427    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632430    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632433    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632435    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632437    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632441    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632443    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632446    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632449    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632451    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632454    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632456    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632458    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632461    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632464    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632467    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:54:22.642005 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632471    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632474    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632478    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632483    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632486    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632489    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632491    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632494    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632501    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632504    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632506    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632509    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632511    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632514    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632516    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632519    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632521    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632524    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632526    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:54:22.642486 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632529    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632531    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632535    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632537    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632540    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632542    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632545    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632548    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632551    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632554    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632557    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632561    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632564    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632567    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632570    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632572    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632575    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632578    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632581    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:54:22.642969 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632583    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632586    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632589    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.632592    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.633547    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.640293    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.640311    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.640331    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.640340    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640408    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640413    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640416    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640419    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640422    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:54:22.643434 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640424    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640427    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640429    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640432    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640434    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640437    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640440    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640442    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640445    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640447    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640450    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640453    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640455    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640458    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640460    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640463    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640465    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640468    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640470    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640473    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:54:22.643792 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640476    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640479    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640481    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640484    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640494    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640497    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640499    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640502    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640504    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640508    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640512    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640515    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640518    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640521    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640524    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640526    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640529    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640533    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640536    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:54:22.644305 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640539    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640542    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640545    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640547    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640550    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640553    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640556    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640559    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640561    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640564    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640567    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640569    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640572    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640574    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640577    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640579    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640582    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640584    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640593    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640596    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:54:22.644771 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640598    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640601    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640603    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640605    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640608    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640610    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640613    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640615    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640617    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640621    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640625    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640627    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640630    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640632    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640635    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640637    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640639    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640643    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640645    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640648    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:54:22.645277 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640651    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640653    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640656    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640658    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640660    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640663    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640665    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640668    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640670    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640673    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640675    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640683    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640686    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640689    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640691    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:54:22.645794 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.640696    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640841    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640847    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640850    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640853    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640856    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640858    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640861    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640864    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640866    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640869    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640872    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640874    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640877    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640879    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640882    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640885    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640887    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640889    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640892    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:54:22.646180 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640894    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640897    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640899    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640902    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640904    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640906    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640909    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640911    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640914    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640922    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640924    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640927    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640929    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640948    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640952    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640956    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640959    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640962    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640965    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:54:22.646676 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640967    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640970    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640972    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640975    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640978    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640981    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640985    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640988    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640991    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640995    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.640999    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641002    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641004    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641007    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641009    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641012    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641014    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641016    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641019    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:54:22.647156 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641021    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641024    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641026    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641029    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641037    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641040    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641042    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641046    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641048    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641051    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641053    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641056    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641058    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641060    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641063    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641066    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641068    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641070    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641073    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:54:22.647630 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641075    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641078    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641080    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641083    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641085    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641088    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641090    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641093    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641095    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641098    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641100    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641103    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641105    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641107    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641110    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641112    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641115    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641117    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641126    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641128    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:54:22.648109 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641131    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:54:22.648584 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641133    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:54:22.648584 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:22.641135    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:54:22.648584 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.641140    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:54:22.648584 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.641264    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 19:54:22.648584 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.643765    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 19:54:22.648584 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.644919    2560 server.go:1019] "Starting client certificate rotation"
Jul 15 19:54:22.648584 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.645019    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 19:54:22.648584 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.645051    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 19:54:22.648584 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.647386    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 19:54:22.650853 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.650834    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 19:54:22.660827 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.660808    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 15 19:54:22.662763 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.662750    2560 log.go:25] "Validated CRI v1 image API"
Jul 15 19:54:22.663574 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.663563    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 19:54:22.668063 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.668040    2560 fs.go:135] Filesystem UUIDs: map[2364e708-904b-438f-83b9-b71345eb2ba3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a012b976-90e1-43b2-8f37-9291a880baa8:/dev/nvme0n1p3]
Jul 15 19:54:22.668106 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.668063    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 19:54:22.673548 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.673384    2560 manager.go:216] Machine: {Timestamp:2026-07-15 19:54:22.672079647 +0000 UTC m=+0.309196928 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099185 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28a4deec6c27305b215582cea10e15 SystemUUID:ec28a4de-ec6c-2730-5b21-5582cea10e15 BootID:1bcaef40-da9a-4cb0-82ee-85063c94ec6e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:44:b7:7c:56:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:44:b7:7c:56:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:c4:30:d5:f6:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 19:54:22.673548 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.673541    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 19:54:22.673644 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.673618    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 19:54:22.676446 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.676423    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 19:54:22.676596 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.676449    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-197.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 19:54:22.677211 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.677201    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 19:54:22.677249 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.677214    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 19:54:22.677249 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.677222    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 19:54:22.677830 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.677821    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 19:54:22.678890 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.678881    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 19:54:22.679136 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.679121    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 19:54:22.681588 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.681577    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 19:54:22.681703 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.681693    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 19:54:22.681747 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.681722    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 19:54:22.681747 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.681732    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 19:54:22.681747 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.681748    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 19:54:22.681862 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.681758    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 15 19:54:22.681862 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.681767    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 19:54:22.682155 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.682144    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 19:54:22.682200 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.682162    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 19:54:22.684656 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.684630    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 19:54:22.686393 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.686376    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 19:54:22.686453 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.686409    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 19:54:22.686608 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.686594    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 19:54:22.686643 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.686618    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 19:54:22.686643 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.686628    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 19:54:22.686643 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.686637    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 19:54:22.686721 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.686648    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 19:54:22.686721 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.686656    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 19:54:22.687120 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.687109    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 19:54:22.687164 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.687121    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 19:54:22.687164 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.687140    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 19:54:22.687164 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.687147    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 19:54:22.687164 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.687155    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 19:54:22.687164 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.687162    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 19:54:22.688042 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.688033    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 19:54:22.688082 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.688043    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 19:54:22.693062 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.693043    2560 server.go:1268] "Started kubelet"
Jul 15 19:54:22.693149 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.693125    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 19:54:22.693149 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.693114    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 19:54:22.693273 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.693180    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 19:54:22.694347 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.694326    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 19:54:22.694434 ip-10-0-135-197 systemd[1]: Started Kubernetes Kubelet.
Jul 15 19:54:22.696045 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.696022    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 19:54:22.696314 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.696291    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 19:54:22.696698 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.696683    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 19:54:22.699300 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.699280    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 19:54:22.700027 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.700013    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 19:54:22.700104 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.700062    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 19:54:22.700208 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.700196    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-197.ec2.internal\" not found"
Jul 15 19:54:22.700208 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.700193    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 19:54:22.700629 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.700613    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 19:54:22.700699 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.700657    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 19:54:22.700699 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.700669    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 19:54:22.700804 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.700791    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 19:54:22.700856 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.700806    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 19:54:22.701112 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.700053    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-197.ec2.internal.18c28ea9e28348e2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-197.ec2.internal,UID:ip-10-0-135-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-197.ec2.internal,},FirstTimestamp:2026-07-15 19:54:22.693009634 +0000 UTC m=+0.330126916,LastTimestamp:2026-07-15 19:54:22.693009634 +0000 UTC m=+0.330126916,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-197.ec2.internal,}"
Jul 15 19:54:22.701203 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.701126    2560 factory.go:55] Registering systemd factory
Jul 15 19:54:22.701203 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.701138    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 15 19:54:22.701380 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.701360    2560 factory.go:153] Registering CRI-O factory
Jul 15 19:54:22.701454 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.701385    2560 factory.go:223] Registration of the crio container factory successfully
Jul 15 19:54:22.701454 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.701441    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 19:54:22.701596 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.701463    2560 factory.go:103] Registering Raw factory
Jul 15 19:54:22.701596 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.701479    2560 manager.go:1196] Started watching for new ooms in manager
Jul 15 19:54:22.701876 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.701864    2560 manager.go:349] Starting recovery of all containers
Jul 15 19:54:22.708700 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.708589    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 19:54:22.708817 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.708796    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 19:54:22.709533 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.709517    2560 manager.go:354] Recovery completed
Jul 15 19:54:22.716002 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.715987    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:54:22.717898 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.717878    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:54:22.718008 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.717911    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:54:22.718008 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.717922    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:54:22.718575 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.718562    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 19:54:22.718575 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.718574    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 19:54:22.718679 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.718589    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 19:54:22.718679 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.718618    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:54:22.719374 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.719358    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:54:22.719451 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.719384    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:54:22.719451 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.719401    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:54:22.719693 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.719682    2560 policy_none.go:49] "None policy: Start"
Jul 15 19:54:22.719722 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.719699    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 19:54:22.719722 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.719709    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 19:54:22.720569 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.720492    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-197.ec2.internal.18c28ea9e3ff09d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-197.ec2.internal,UID:ip-10-0-135-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-197.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-197.ec2.internal,},FirstTimestamp:2026-07-15 19:54:22.717897171 +0000 UTC m=+0.355014451,LastTimestamp:2026-07-15 19:54:22.717897171 +0000 UTC m=+0.355014451,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-197.ec2.internal,}"
Jul 15 19:54:22.720715 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.720704    2560 policy_none.go:47] "Start"
Jul 15 19:54:22.725754 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.725740    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mtwbm"
Jul 15 19:54:22.731892 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.731834    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-197.ec2.internal.18c28ea9e3ff5541  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-197.ec2.internal,UID:ip-10-0-135-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-197.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-197.ec2.internal,},FirstTimestamp:2026-07-15 19:54:22.717916481 +0000 UTC m=+0.355033765,LastTimestamp:2026-07-15 19:54:22.717916481 +0000 UTC m=+0.355033765,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-197.ec2.internal,}"
Jul 15 19:54:22.739462 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.739445    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mtwbm"
Jul 15 19:54:22.758464 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.758445    2560 manager.go:337] "Starting Device Plugin manager"
Jul 15 19:54:22.758542 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.758473    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 19:54:22.758542 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.758482    2560 server.go:87] "Starting device plugin registration server"
Jul 15 19:54:22.758737 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.758723    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 19:54:22.758823 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.758737    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 19:54:22.758823 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.758819    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 19:54:22.758923 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.758896    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 19:54:22.758923 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.758904    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 19:54:22.759397 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.759376    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 19:54:22.759466 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.759426    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-197.ec2.internal\" not found"
Jul 15 19:54:22.859102 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.859076    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:54:22.860337 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.860108    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:54:22.860337 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.860135    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:54:22.860337 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.860146    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:54:22.860337 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.860170    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-197.ec2.internal"
Jul 15 19:54:22.867032 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.867016    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-197.ec2.internal"
Jul 15 19:54:22.867125 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.867040    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-197.ec2.internal\": node \"ip-10-0-135-197.ec2.internal\" not found"
Jul 15 19:54:22.887217 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.887162    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 19:54:22.888517 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.888496    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 19:54:22.888582 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.888532    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 19:54:22.888582 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.888552    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 19:54:22.888661 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.888583    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 19:54:22.891040 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.891023    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:54:22.895103 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.895083    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-197.ec2.internal\" not found"
Jul 15 19:54:22.989615 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.989591    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-197.ec2.internal"]
Jul 15 19:54:22.989708 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.989653    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:54:22.990486 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.990471    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:54:22.990545 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.990499    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:54:22.990545 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.990509    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:54:22.991676 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.991664    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:54:22.991793 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.991775    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:22.991877 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.991821    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:54:22.992413 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.992398    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:54:22.992413 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.992405    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:54:22.992517 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.992429    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:54:22.992517 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.992432    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:54:22.992517 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.992441    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:54:22.992517 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.992448    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:54:22.993506 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.993493    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:22.993546 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.993520    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:54:22.994154 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.994139    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:54:22.994209 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.994171    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:54:22.994209 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:22.994187    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:54:22.995367 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:22.995354    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-197.ec2.internal\" not found"
Jul 15 19:54:23.001993 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.001979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a988acd2f800074fc02d09d68b87b957-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal\" (UID: \"a988acd2f800074fc02d09d68b87b957\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.002055 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.002000    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c92467abfb01b67486eb8e097ce3440a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-197.ec2.internal\" (UID: \"c92467abfb01b67486eb8e097ce3440a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.002055 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.002017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a988acd2f800074fc02d09d68b87b957-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal\" (UID: \"a988acd2f800074fc02d09d68b87b957\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.018554 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:23.018533    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-197.ec2.internal\" not found" node="ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.022556 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:23.022538    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-197.ec2.internal\" not found" node="ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.096114 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:23.096090    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-197.ec2.internal\" not found"
Jul 15 19:54:23.102424 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.102408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a988acd2f800074fc02d09d68b87b957-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal\" (UID: \"a988acd2f800074fc02d09d68b87b957\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.102499 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.102434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a988acd2f800074fc02d09d68b87b957-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal\" (UID: \"a988acd2f800074fc02d09d68b87b957\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.102499 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.102450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c92467abfb01b67486eb8e097ce3440a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-197.ec2.internal\" (UID: \"c92467abfb01b67486eb8e097ce3440a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.102499 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.102493    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c92467abfb01b67486eb8e097ce3440a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-197.ec2.internal\" (UID: \"c92467abfb01b67486eb8e097ce3440a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.102613 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.102513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a988acd2f800074fc02d09d68b87b957-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal\" (UID: \"a988acd2f800074fc02d09d68b87b957\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.102613 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.102513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a988acd2f800074fc02d09d68b87b957-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal\" (UID: \"a988acd2f800074fc02d09d68b87b957\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.197130 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:23.197066    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-197.ec2.internal\" not found"
Jul 15 19:54:23.297562 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:23.297534    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-197.ec2.internal\" not found"
Jul 15 19:54:23.321002 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.320982    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.324569 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.324549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.398122 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:23.398090    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-197.ec2.internal\" not found"
Jul 15 19:54:23.498611 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:23.498557    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-197.ec2.internal\" not found"
Jul 15 19:54:23.599585 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:23.599552    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-197.ec2.internal\" not found"
Jul 15 19:54:23.630732 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.630707    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:54:23.644996 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.644971    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 19:54:23.645147 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.645126    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 19:54:23.645147 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.645135    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 19:54:23.699765 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:23.699737    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-197.ec2.internal\" not found"
Jul 15 19:54:23.742563 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.742530    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 19:49:23 +0000 UTC" deadline="2027-12-24 03:43:21.417133123 +0000 UTC"
Jul 15 19:54:23.742563 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.742561    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12631h48m57.674575563s"
Jul 15 19:54:23.743042 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.743012    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:54:23.800791 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.800711    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.817624 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.817601    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 19:54:23.818699 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.818678    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-197.ec2.internal"
Jul 15 19:54:23.820812 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:23.820784    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda988acd2f800074fc02d09d68b87b957.slice/crio-4e42903adee4df822cb8a19587d50d5df158a6483c972e1940d8f9f28455a7cb WatchSource:0}: Error finding container 4e42903adee4df822cb8a19587d50d5df158a6483c972e1940d8f9f28455a7cb: Status 404 returned error can't find the container with id 4e42903adee4df822cb8a19587d50d5df158a6483c972e1940d8f9f28455a7cb
Jul 15 19:54:23.821186 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:23.821166    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92467abfb01b67486eb8e097ce3440a.slice/crio-52ad50381b80ef1b7ba4e6dfa6b2f1f74d076ba2611cd862b39c85745c2c065a WatchSource:0}: Error finding container 52ad50381b80ef1b7ba4e6dfa6b2f1f74d076ba2611cd862b39c85745c2c065a: Status 404 returned error can't find the container with id 52ad50381b80ef1b7ba4e6dfa6b2f1f74d076ba2611cd862b39c85745c2c065a
Jul 15 19:54:23.825722 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.825707    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:54:23.837802 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.837785    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 19:54:23.891601 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.891557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal" event={"ID":"a988acd2f800074fc02d09d68b87b957","Type":"ContainerStarted","Data":"4e42903adee4df822cb8a19587d50d5df158a6483c972e1940d8f9f28455a7cb"}
Jul 15 19:54:23.892665 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.892644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-197.ec2.internal" event={"ID":"c92467abfb01b67486eb8e097ce3440a","Type":"ContainerStarted","Data":"52ad50381b80ef1b7ba4e6dfa6b2f1f74d076ba2611cd862b39c85745c2c065a"}
Jul 15 19:54:23.984199 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:23.984178    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:54:24.684027 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.683992    2560 apiserver.go:52] "Watching apiserver"
Jul 15 19:54:24.693883 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.693852    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 19:54:24.694430 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.694405    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-197.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl","openshift-cluster-node-tuning-operator/tuned-h8m4j","openshift-dns/node-resolver-6sf8b","openshift-image-registry/node-ca-9gbzl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal","openshift-multus/multus-2mr7m","kube-system/konnectivity-agent-lst2f","openshift-multus/multus-additional-cni-plugins-5ktsf","openshift-multus/network-metrics-daemon-vtgkp","openshift-network-diagnostics/network-check-target-k8sd5","openshift-network-operator/iptables-alerter-ppbh4","openshift-ovn-kubernetes/ovnkube-node-2g2mw","kube-system/global-pull-secret-syncer-npph7"]
Jul 15 19:54:24.695929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.695909    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.697427 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.697400    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.698638 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.698614    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.699843 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.699417    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zhzz2\""
Jul 15 19:54:24.699843 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.699539    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 19:54:24.699843 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.699642    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 19:54:24.699843 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.699706    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 19:54:24.699843 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.699810    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 19:54:24.700170 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.700102    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6sf8b"
Jul 15 19:54:24.700569 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.700551    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 19:54:24.701359 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.700739    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 19:54:24.701610 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.701577    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 19:54:24.701700 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.701612    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 19:54:24.702820 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.702492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9gbzl"
Jul 15 19:54:24.702820 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.702714    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.704986    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.705257    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.705487    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xw9vs\""
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.707055    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.707372    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2fkml\""
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.707606    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.707760    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.708538    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.708684    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.708702    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g642n\""
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.708804    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.709161    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:24.709348 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:24.709262    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:24.710174 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.709466    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.712163 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712144    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lst2f"
Jul 15 19:54:24.712398 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-run-openvswitch\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.712475 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712405    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-run-multus-certs\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.712475 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-run-ovn\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.712475 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/240b2452-aa6d-4036-8696-a2a9b8130697-ovnkube-script-lib\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.712475 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-node-log\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.712475 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-var-lib-kubelet\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.712741 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1438ef8-fe0e-4c34-a667-36467bdb520d-tmp\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.712741 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712516    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-system-cni-dir\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.712741 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712540    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-os-release\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.712741 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-hostroot\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.712741 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-etc-kubernetes\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.712741 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-cni-netd\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.712741 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c2d28289-371c-4a8f-90d9-445c4717085d-hosts-file\") pod \"node-resolver-6sf8b\" (UID: \"c2d28289-371c-4a8f-90d9-445c4717085d\") " pod="openshift-dns/node-resolver-6sf8b"
Jul 15 19:54:24.712741 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70e0d3b8-298c-4cee-be41-9e559fbd3711-host\") pod \"node-ca-9gbzl\" (UID: \"70e0d3b8-298c-4cee-be41-9e559fbd3711\") " pod="openshift-image-registry/node-ca-9gbzl"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712747    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6xzw\" (UniqueName: \"kubernetes.io/projected/70e0d3b8-298c-4cee-be41-9e559fbd3711-kube-api-access-m6xzw\") pod \"node-ca-9gbzl\" (UID: \"70e0d3b8-298c-4cee-be41-9e559fbd3711\") " pod="openshift-image-registry/node-ca-9gbzl"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-var-lib-kubelet\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-run-ovn-kubernetes\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-sys\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-lib-modules\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-sysctl-conf\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-multus-cni-dir\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-systemd-units\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.712986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-run-systemd\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/240b2452-aa6d-4036-8696-a2a9b8130697-ovn-node-metrics-cert\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-host\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcq7x\" (UniqueName: \"kubernetes.io/projected/c2d28289-371c-4a8f-90d9-445c4717085d-kube-api-access-bcq7x\") pod \"node-resolver-6sf8b\" (UID: \"c2d28289-371c-4a8f-90d9-445c4717085d\") " pod="openshift-dns/node-resolver-6sf8b"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-run-k8s-cni-cncf-io\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-var-lib-cni-bin\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.713205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-cni-bin\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-log-socket\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-tuned\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-kubelet\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713339    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-var-lib-openvswitch\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-run-netns\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713431    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-modprobe-d\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2d28289-371c-4a8f-90d9-445c4717085d-tmp-dir\") pod \"node-resolver-6sf8b\" (UID: \"c2d28289-371c-4a8f-90d9-445c4717085d\") " pod="openshift-dns/node-resolver-6sf8b"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-run-netns\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-etc-openvswitch\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713581    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-kubernetes\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713610    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/240b2452-aa6d-4036-8696-a2a9b8130697-env-overrides\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-systemd\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713656    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-var-lib-cni-multus\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713671    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-cnibin\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713685    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-multus-socket-dir-parent\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.713954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79a2509f-740e-4887-a185-47bf2ea1035a-multus-daemon-config\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.714625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713715    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-slash\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.714625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ttng\" (UniqueName: \"kubernetes.io/projected/240b2452-aa6d-4036-8696-a2a9b8130697-kube-api-access-8ttng\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.714625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kssnk\" (UniqueName: \"kubernetes.io/projected/79a2509f-740e-4887-a185-47bf2ea1035a-kube-api-access-kssnk\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.714625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79a2509f-740e-4887-a185-47bf2ea1035a-cni-binary-copy\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.714625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-multus-conf-dir\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.714625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/240b2452-aa6d-4036-8696-a2a9b8130697-ovnkube-config\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.714625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713889    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.714625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-sysconfig\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.714625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-run\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.714625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmnjf\" (UniqueName: \"kubernetes.io/projected/e1438ef8-fe0e-4c34-a667-36467bdb520d-kube-api-access-mmnjf\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.714625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.713983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70e0d3b8-298c-4cee-be41-9e559fbd3711-serviceca\") pod \"node-ca-9gbzl\" (UID: \"70e0d3b8-298c-4cee-be41-9e559fbd3711\") " pod="openshift-image-registry/node-ca-9gbzl"
Jul 15 19:54:24.714625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.714005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-sysctl-d\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.715476 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.715456    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:24.715590 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:24.715548    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:24.717117 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.717094    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:24.717216 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:24.717174    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:24.718232 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.718192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ppbh4"
Jul 15 19:54:24.718544 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.718529    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 19:54:24.718660 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.718648    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 19:54:24.719454 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.718732    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 19:54:24.719454 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.718800    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 19:54:24.719454 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.718874    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nxm5c\""
Jul 15 19:54:24.719454 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.718963    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9ptfk\""
Jul 15 19:54:24.719454 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.719047    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 19:54:24.719454 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.719165    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-89xvb\""
Jul 15 19:54:24.719454 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.719276    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ldplg\""
Jul 15 19:54:24.719454 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.719346    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 19:54:24.719866 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.719505    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 19:54:24.719866 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.719647    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 19:54:24.732205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.731534    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 19:54:24.732205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.731794    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:54:24.732205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.731882    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 19:54:24.732205 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.732058    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8772t\""
Jul 15 19:54:24.741930 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.741905    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 19:54:24.755965 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.755925    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n72cl"
Jul 15 19:54:24.768175 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.768156    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n72cl"
Jul 15 19:54:24.802094 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.802067    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 19:54:24.814169 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814146    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-system-cni-dir\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.814319 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-os-release\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.814319 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-hostroot\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.814319 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-etc-kubernetes\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.814319 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814259    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-cni-netd\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.814319 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814284    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c2d28289-371c-4a8f-90d9-445c4717085d-hosts-file\") pod \"node-resolver-6sf8b\" (UID: \"c2d28289-371c-4a8f-90d9-445c4717085d\") " pod="openshift-dns/node-resolver-6sf8b"
Jul 15 19:54:24.814319 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70e0d3b8-298c-4cee-be41-9e559fbd3711-host\") pod \"node-ca-9gbzl\" (UID: \"70e0d3b8-298c-4cee-be41-9e559fbd3711\") " pod="openshift-image-registry/node-ca-9gbzl"
Jul 15 19:54:24.814666 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6xzw\" (UniqueName: \"kubernetes.io/projected/70e0d3b8-298c-4cee-be41-9e559fbd3711-kube-api-access-m6xzw\") pod \"node-ca-9gbzl\" (UID: \"70e0d3b8-298c-4cee-be41-9e559fbd3711\") " pod="openshift-image-registry/node-ca-9gbzl"
Jul 15 19:54:24.814666 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814356    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-var-lib-kubelet\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.814666 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-run-ovn-kubernetes\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.814666 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814413    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-sys\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.814666 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-lib-modules\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.814666 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-sysctl-conf\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.814666 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814495    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cn8h\" (UniqueName: \"kubernetes.io/projected/c737f5ff-71e2-495d-a216-2a475079a6ff-kube-api-access-2cn8h\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.814666 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-multus-cni-dir\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.814666 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-systemd-units\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.814666 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-run-systemd\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.814666 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/240b2452-aa6d-4036-8696-a2a9b8130697-ovn-node-metrics-cert\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.814666 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-host\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcq7x\" (UniqueName: \"kubernetes.io/projected/c2d28289-371c-4a8f-90d9-445c4717085d-kube-api-access-bcq7x\") pod \"node-resolver-6sf8b\" (UID: \"c2d28289-371c-4a8f-90d9-445c4717085d\") " pod="openshift-dns/node-resolver-6sf8b"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-run-k8s-cni-cncf-io\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-var-lib-cni-bin\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-cni-bin\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/285224d2-fbcd-482f-8422-9a328b6e726e-agent-certs\") pod \"konnectivity-agent-lst2f\" (UID: \"285224d2-fbcd-482f-8422-9a328b6e726e\") " pod="kube-system/konnectivity-agent-lst2f"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljfj4\" (UniqueName: \"kubernetes.io/projected/e16ebf3f-721e-45b8-88f9-9d5749b3c8be-kube-api-access-ljfj4\") pod \"iptables-alerter-ppbh4\" (UID: \"e16ebf3f-721e-45b8-88f9-9d5749b3c8be\") " pod="openshift-network-operator/iptables-alerter-ppbh4"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/539ac057-2627-43ac-af87-9b44e3d25a4f-cnibin\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/539ac057-2627-43ac-af87-9b44e3d25a4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814919    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-log-socket\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814944    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-tuned\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/539ac057-2627-43ac-af87-9b44e3d25a4f-system-cni-dir\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.814995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdnz7\" (UniqueName: \"kubernetes.io/projected/539ac057-2627-43ac-af87-9b44e3d25a4f-kube-api-access-zdnz7\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-kubelet\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-var-lib-openvswitch\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.815324 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-registration-dir\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815177    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-run-systemd\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815185    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-kubelet-config\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-system-cni-dir\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815265    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-hostroot\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815263    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-run-netns\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-modprobe-d\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-run-netns\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2d28289-371c-4a8f-90d9-445c4717085d-tmp-dir\") pod \"node-resolver-6sf8b\" (UID: \"c2d28289-371c-4a8f-90d9-445c4717085d\") " pod="openshift-dns/node-resolver-6sf8b"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815369    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/539ac057-2627-43ac-af87-9b44e3d25a4f-os-release\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815395    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-dbus\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-run-netns\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815470    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-etc-openvswitch\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-kubernetes\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.816132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/539ac057-2627-43ac-af87-9b44e3d25a4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815552    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2d28289-371c-4a8f-90d9-445c4717085d-tmp-dir\") pod \"node-resolver-6sf8b\" (UID: \"c2d28289-371c-4a8f-90d9-445c4717085d\") " pod="openshift-dns/node-resolver-6sf8b"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-host\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815869    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-run-k8s-cni-cncf-io\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815976    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-var-lib-cni-bin\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-cni-bin\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816146    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-log-socket\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-etc-kubernetes\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816557    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c2d28289-371c-4a8f-90d9-445c4717085d-hosts-file\") pod \"node-resolver-6sf8b\" (UID: \"c2d28289-371c-4a8f-90d9-445c4717085d\") " pod="openshift-dns/node-resolver-6sf8b"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-cni-netd\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816618    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70e0d3b8-298c-4cee-be41-9e559fbd3711-host\") pod \"node-ca-9gbzl\" (UID: \"70e0d3b8-298c-4cee-be41-9e559fbd3711\") " pod="openshift-image-registry/node-ca-9gbzl"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816666    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-var-lib-openvswitch\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816708    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-kubelet\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816753    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-multus-cni-dir\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816893    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-systemd-units\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-sysctl-conf\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.817059 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.816963    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-var-lib-kubelet\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-modprobe-d\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.815551    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/539ac057-2627-43ac-af87-9b44e3d25a4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817028    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-run-ovn-kubernetes\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/240b2452-aa6d-4036-8696-a2a9b8130697-env-overrides\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817085    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-sys\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-systemd\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/285224d2-fbcd-482f-8422-9a328b6e726e-konnectivity-ca\") pod \"konnectivity-agent-lst2f\" (UID: \"285224d2-fbcd-482f-8422-9a328b6e726e\") " pod="kube-system/konnectivity-agent-lst2f"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-sys-fs\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsmns\" (UniqueName: \"kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns\") pod \"network-check-target-k8sd5\" (UID: \"702d07b3-f02e-4d5d-a384-be6d2d534797\") " pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817191    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-lib-modules\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817202    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-var-lib-cni-multus\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-cnibin\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-multus-socket-dir-parent\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79a2509f-740e-4887-a185-47bf2ea1035a-multus-daemon-config\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817315    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-slash\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-os-release\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.817929 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817485    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-var-lib-cni-multus\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.817980    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/240b2452-aa6d-4036-8696-a2a9b8130697-env-overrides\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-systemd\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818058    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79a2509f-740e-4887-a185-47bf2ea1035a-multus-daemon-config\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-cnibin\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-multus-socket-dir-parent\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ttng\" (UniqueName: \"kubernetes.io/projected/240b2452-aa6d-4036-8696-a2a9b8130697-kube-api-access-8ttng\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-socket-dir\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-device-dir\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kssnk\" (UniqueName: \"kubernetes.io/projected/79a2509f-740e-4887-a185-47bf2ea1035a-kube-api-access-kssnk\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79a2509f-740e-4887-a185-47bf2ea1035a-cni-binary-copy\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-multus-conf-dir\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/240b2452-aa6d-4036-8696-a2a9b8130697-ovnkube-config\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818441    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-sysconfig\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-run\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmnjf\" (UniqueName: \"kubernetes.io/projected/e1438ef8-fe0e-4c34-a667-36467bdb520d-kube-api-access-mmnjf\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818519    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70e0d3b8-298c-4cee-be41-9e559fbd3711-serviceca\") pod \"node-ca-9gbzl\" (UID: \"70e0d3b8-298c-4cee-be41-9e559fbd3711\") " pod="openshift-image-registry/node-ca-9gbzl"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818592    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-etc-openvswitch\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.818867 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-run-netns\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818660    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-sysctl-d\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e16ebf3f-721e-45b8-88f9-9d5749b3c8be-iptables-alerter-script\") pod \"iptables-alerter-ppbh4\" (UID: \"e16ebf3f-721e-45b8-88f9-9d5749b3c8be\") " pod="openshift-network-operator/iptables-alerter-ppbh4"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e16ebf3f-721e-45b8-88f9-9d5749b3c8be-host-slash\") pod \"iptables-alerter-ppbh4\" (UID: \"e16ebf3f-721e-45b8-88f9-9d5749b3c8be\") " pod="openshift-network-operator/iptables-alerter-ppbh4"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/539ac057-2627-43ac-af87-9b44e3d25a4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s86wk\" (UniqueName: \"kubernetes.io/projected/d15aacac-717b-4c46-866c-1c0d823ebd4a-kube-api-access-s86wk\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-run-openvswitch\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-run-multus-certs\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818856    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-run-ovn\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/240b2452-aa6d-4036-8696-a2a9b8130697-ovnkube-script-lib\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-node-log\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-var-lib-kubelet\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.818993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1438ef8-fe0e-4c34-a667-36467bdb520d-tmp\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.819337    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-multus-conf-dir\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.819389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-kubernetes\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.819467    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-host-slash\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.819798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.819554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/240b2452-aa6d-4036-8696-a2a9b8130697-ovnkube-config\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.820645 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.819631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-sysconfig\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.820645 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.819693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-run\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.820645 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.819797    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-run-openvswitch\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.820645 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.819839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70e0d3b8-298c-4cee-be41-9e559fbd3711-serviceca\") pod \"node-ca-9gbzl\" (UID: \"70e0d3b8-298c-4cee-be41-9e559fbd3711\") " pod="openshift-image-registry/node-ca-9gbzl"
Jul 15 19:54:24.820645 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.820062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-sysctl-d\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.820645 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.820089    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79a2509f-740e-4887-a185-47bf2ea1035a-cni-binary-copy\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.820645 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.820148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-node-log\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.820645 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.820207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1438ef8-fe0e-4c34-a667-36467bdb520d-var-lib-kubelet\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.820645 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.820245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/240b2452-aa6d-4036-8696-a2a9b8130697-run-ovn\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.820645 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.820284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79a2509f-740e-4887-a185-47bf2ea1035a-host-run-multus-certs\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.820645 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.820630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/240b2452-aa6d-4036-8696-a2a9b8130697-ovnkube-script-lib\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.822036 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.821604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/240b2452-aa6d-4036-8696-a2a9b8130697-ovn-node-metrics-cert\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.822584 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.822563    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1438ef8-fe0e-4c34-a667-36467bdb520d-etc-tuned\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.829664 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.828561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6xzw\" (UniqueName: \"kubernetes.io/projected/70e0d3b8-298c-4cee-be41-9e559fbd3711-kube-api-access-m6xzw\") pod \"node-ca-9gbzl\" (UID: \"70e0d3b8-298c-4cee-be41-9e559fbd3711\") " pod="openshift-image-registry/node-ca-9gbzl"
Jul 15 19:54:24.829664 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.828979    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcq7x\" (UniqueName: \"kubernetes.io/projected/c2d28289-371c-4a8f-90d9-445c4717085d-kube-api-access-bcq7x\") pod \"node-resolver-6sf8b\" (UID: \"c2d28289-371c-4a8f-90d9-445c4717085d\") " pod="openshift-dns/node-resolver-6sf8b"
Jul 15 19:54:24.830639 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.830579    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ttng\" (UniqueName: \"kubernetes.io/projected/240b2452-aa6d-4036-8696-a2a9b8130697-kube-api-access-8ttng\") pod \"ovnkube-node-2g2mw\" (UID: \"240b2452-aa6d-4036-8696-a2a9b8130697\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:24.830990 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.830970    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1438ef8-fe0e-4c34-a667-36467bdb520d-tmp\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.831486 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.831434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kssnk\" (UniqueName: \"kubernetes.io/projected/79a2509f-740e-4887-a185-47bf2ea1035a-kube-api-access-kssnk\") pod \"multus-2mr7m\" (UID: \"79a2509f-740e-4887-a185-47bf2ea1035a\") " pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:24.834340 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.834315    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmnjf\" (UniqueName: \"kubernetes.io/projected/e1438ef8-fe0e-4c34-a667-36467bdb520d-kube-api-access-mmnjf\") pod \"tuned-h8m4j\" (UID: \"e1438ef8-fe0e-4c34-a667-36467bdb520d\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.919732    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e16ebf3f-721e-45b8-88f9-9d5749b3c8be-iptables-alerter-script\") pod \"iptables-alerter-ppbh4\" (UID: \"e16ebf3f-721e-45b8-88f9-9d5749b3c8be\") " pod="openshift-network-operator/iptables-alerter-ppbh4"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.919775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e16ebf3f-721e-45b8-88f9-9d5749b3c8be-host-slash\") pod \"iptables-alerter-ppbh4\" (UID: \"e16ebf3f-721e-45b8-88f9-9d5749b3c8be\") " pod="openshift-network-operator/iptables-alerter-ppbh4"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.919793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/539ac057-2627-43ac-af87-9b44e3d25a4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.919809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s86wk\" (UniqueName: \"kubernetes.io/projected/d15aacac-717b-4c46-866c-1c0d823ebd4a-kube-api-access-s86wk\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.919826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.919857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cn8h\" (UniqueName: \"kubernetes.io/projected/c737f5ff-71e2-495d-a216-2a475079a6ff-kube-api-access-2cn8h\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.919879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/285224d2-fbcd-482f-8422-9a328b6e726e-agent-certs\") pod \"konnectivity-agent-lst2f\" (UID: \"285224d2-fbcd-482f-8422-9a328b6e726e\") " pod="kube-system/konnectivity-agent-lst2f"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.919895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.919921    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljfj4\" (UniqueName: \"kubernetes.io/projected/e16ebf3f-721e-45b8-88f9-9d5749b3c8be-kube-api-access-ljfj4\") pod \"iptables-alerter-ppbh4\" (UID: \"e16ebf3f-721e-45b8-88f9-9d5749b3c8be\") " pod="openshift-network-operator/iptables-alerter-ppbh4"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.919938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/539ac057-2627-43ac-af87-9b44e3d25a4f-cnibin\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.919980    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/539ac057-2627-43ac-af87-9b44e3d25a4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/539ac057-2627-43ac-af87-9b44e3d25a4f-system-cni-dir\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdnz7\" (UniqueName: \"kubernetes.io/projected/539ac057-2627-43ac-af87-9b44e3d25a4f-kube-api-access-zdnz7\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-registration-dir\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.922539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-kubelet-config\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/539ac057-2627-43ac-af87-9b44e3d25a4f-os-release\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-dbus\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920185    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/539ac057-2627-43ac-af87-9b44e3d25a4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/539ac057-2627-43ac-af87-9b44e3d25a4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/285224d2-fbcd-482f-8422-9a328b6e726e-konnectivity-ca\") pod \"konnectivity-agent-lst2f\" (UID: \"285224d2-fbcd-482f-8422-9a328b6e726e\") " pod="kube-system/konnectivity-agent-lst2f"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-sys-fs\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920256    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmns\" (UniqueName: \"kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns\") pod \"network-check-target-k8sd5\" (UID: \"702d07b3-f02e-4d5d-a384-be6d2d534797\") " pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-socket-dir\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-device-dir\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-device-dir\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.920974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e16ebf3f-721e-45b8-88f9-9d5749b3c8be-iptables-alerter-script\") pod \"iptables-alerter-ppbh4\" (UID: \"e16ebf3f-721e-45b8-88f9-9d5749b3c8be\") " pod="openshift-network-operator/iptables-alerter-ppbh4"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.921109    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.921329    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/539ac057-2627-43ac-af87-9b44e3d25a4f-cnibin\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.921530    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/539ac057-2627-43ac-af87-9b44e3d25a4f-system-cni-dir\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.921622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e16ebf3f-721e-45b8-88f9-9d5749b3c8be-host-slash\") pod \"iptables-alerter-ppbh4\" (UID: \"e16ebf3f-721e-45b8-88f9-9d5749b3c8be\") " pod="openshift-network-operator/iptables-alerter-ppbh4"
Jul 15 19:54:24.923481 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.921690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-kubelet-config\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.921701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-dbus\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.921803    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:24.921825    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.921844    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/539ac057-2627-43ac-af87-9b44e3d25a4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.921854    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-registration-dir\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.921925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/539ac057-2627-43ac-af87-9b44e3d25a4f-os-release\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:24.921935    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret podName:a59c139c-c5f1-4bc1-9a89-cc09b82663c5 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:25.421887157 +0000 UTC m=+3.059004445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret") pod "global-pull-secret-syncer-npph7" (UID: "a59c139c-c5f1-4bc1-9a89-cc09b82663c5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.921860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/539ac057-2627-43ac-af87-9b44e3d25a4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:24.922197    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:24.922305    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs podName:d15aacac-717b-4c46-866c-1c0d823ebd4a nodeName:}" failed. No retries permitted until 2026-07-15 19:54:25.422284491 +0000 UTC m=+3.059401780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs") pod "network-metrics-daemon-vtgkp" (UID: "d15aacac-717b-4c46-866c-1c0d823ebd4a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.922482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/285224d2-fbcd-482f-8422-9a328b6e726e-konnectivity-ca\") pod \"konnectivity-agent-lst2f\" (UID: \"285224d2-fbcd-482f-8422-9a328b6e726e\") " pod="kube-system/konnectivity-agent-lst2f"
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.922487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-sys-fs\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.922598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c737f5ff-71e2-495d-a216-2a475079a6ff-socket-dir\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.922784    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/539ac057-2627-43ac-af87-9b44e3d25a4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.924288 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.922892    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/539ac057-2627-43ac-af87-9b44e3d25a4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.925261 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.925205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/285224d2-fbcd-482f-8422-9a328b6e726e-agent-certs\") pod \"konnectivity-agent-lst2f\" (UID: \"285224d2-fbcd-482f-8422-9a328b6e726e\") " pod="kube-system/konnectivity-agent-lst2f"
Jul 15 19:54:24.932298 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:24.931854    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:54:24.932298 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:24.931882    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:54:24.932298 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:24.931897    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jsmns for pod openshift-network-diagnostics/network-check-target-k8sd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:24.932298 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:24.931986    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns podName:702d07b3-f02e-4d5d-a384-be6d2d534797 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:25.431946664 +0000 UTC m=+3.069063940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jsmns" (UniqueName: "kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns") pod "network-check-target-k8sd5" (UID: "702d07b3-f02e-4d5d-a384-be6d2d534797") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:24.937424 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.937345    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdnz7\" (UniqueName: \"kubernetes.io/projected/539ac057-2627-43ac-af87-9b44e3d25a4f-kube-api-access-zdnz7\") pod \"multus-additional-cni-plugins-5ktsf\" (UID: \"539ac057-2627-43ac-af87-9b44e3d25a4f\") " pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:24.937525 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.937441    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s86wk\" (UniqueName: \"kubernetes.io/projected/d15aacac-717b-4c46-866c-1c0d823ebd4a-kube-api-access-s86wk\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:24.938120 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.938077    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cn8h\" (UniqueName: \"kubernetes.io/projected/c737f5ff-71e2-495d-a216-2a475079a6ff-kube-api-access-2cn8h\") pod \"aws-ebs-csi-driver-node-6dpgl\" (UID: \"c737f5ff-71e2-495d-a216-2a475079a6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:24.939343 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.939316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljfj4\" (UniqueName: \"kubernetes.io/projected/e16ebf3f-721e-45b8-88f9-9d5749b3c8be-kube-api-access-ljfj4\") pod \"iptables-alerter-ppbh4\" (UID: \"e16ebf3f-721e-45b8-88f9-9d5749b3c8be\") " pod="openshift-network-operator/iptables-alerter-ppbh4"
Jul 15 19:54:24.982243 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:24.982213    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:54:25.017677 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.017648    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2mr7m"
Jul 15 19:54:25.025609 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.025589    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:25.037201 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.036987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ppbh4"
Jul 15 19:54:25.044062 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.044033    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8m4j"
Jul 15 19:54:25.051721 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.051693    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6sf8b"
Jul 15 19:54:25.058809 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.058776    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9gbzl"
Jul 15 19:54:25.067423 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.067396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5ktsf"
Jul 15 19:54:25.074253 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.074102    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lst2f"
Jul 15 19:54:25.079716 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.079695    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl"
Jul 15 19:54:25.121467 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:25.121426    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539ac057_2627_43ac_af87_9b44e3d25a4f.slice/crio-b29688f13a50866e399a4b43dd8e3ecc692e79bffc69dfa91c22f4badb3d3ab5 WatchSource:0}: Error finding container b29688f13a50866e399a4b43dd8e3ecc692e79bffc69dfa91c22f4badb3d3ab5: Status 404 returned error can't find the container with id b29688f13a50866e399a4b43dd8e3ecc692e79bffc69dfa91c22f4badb3d3ab5
Jul 15 19:54:25.424206 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.424115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:25.424206 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.424178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:25.424438 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:25.424292    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:25.424438 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:25.424341    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:25.424438 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:25.424373    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs podName:d15aacac-717b-4c46-866c-1c0d823ebd4a nodeName:}" failed. No retries permitted until 2026-07-15 19:54:26.424352276 +0000 UTC m=+4.061469545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs") pod "network-metrics-daemon-vtgkp" (UID: "d15aacac-717b-4c46-866c-1c0d823ebd4a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:25.424438 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:25.424397    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret podName:a59c139c-c5f1-4bc1-9a89-cc09b82663c5 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:26.424383616 +0000 UTC m=+4.061500886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret") pod "global-pull-secret-syncer-npph7" (UID: "a59c139c-c5f1-4bc1-9a89-cc09b82663c5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:25.511698 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:25.511660    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285224d2_fbcd_482f_8422_9a328b6e726e.slice/crio-d0b152a3f9df3b32fd05525a56d72ac023aa1d255146ca56f9ccf7d2a7e3cf63 WatchSource:0}: Error finding container d0b152a3f9df3b32fd05525a56d72ac023aa1d255146ca56f9ccf7d2a7e3cf63: Status 404 returned error can't find the container with id d0b152a3f9df3b32fd05525a56d72ac023aa1d255146ca56f9ccf7d2a7e3cf63
Jul 15 19:54:25.512266 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:25.512231    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e0d3b8_298c_4cee_be41_9e559fbd3711.slice/crio-52df837d0c80382c00b9e392b90f03a43f326ab8a42892dabb9926a75b9e3dc1 WatchSource:0}: Error finding container 52df837d0c80382c00b9e392b90f03a43f326ab8a42892dabb9926a75b9e3dc1: Status 404 returned error can't find the container with id 52df837d0c80382c00b9e392b90f03a43f326ab8a42892dabb9926a75b9e3dc1
Jul 15 19:54:25.513103 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:25.513082    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16ebf3f_721e_45b8_88f9_9d5749b3c8be.slice/crio-ef76088328c9595e74eca509611d6d276288ad588dd3be84e0de3dbe23ddefec WatchSource:0}: Error finding container ef76088328c9595e74eca509611d6d276288ad588dd3be84e0de3dbe23ddefec: Status 404 returned error can't find the container with id ef76088328c9595e74eca509611d6d276288ad588dd3be84e0de3dbe23ddefec
Jul 15 19:54:25.514823 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:25.514673    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d28289_371c_4a8f_90d9_445c4717085d.slice/crio-4f6a0b2b094fe0073b36124d8c4c96663bc9435b370320e7c7df91f2eaa3596a WatchSource:0}: Error finding container 4f6a0b2b094fe0073b36124d8c4c96663bc9435b370320e7c7df91f2eaa3596a: Status 404 returned error can't find the container with id 4f6a0b2b094fe0073b36124d8c4c96663bc9435b370320e7c7df91f2eaa3596a
Jul 15 19:54:25.515754 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:25.515705    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1438ef8_fe0e_4c34_a667_36467bdb520d.slice/crio-26ccd44626ef12efe19ee8202070eba63c972d23c56a3a0fbd439c3e4245114e WatchSource:0}: Error finding container 26ccd44626ef12efe19ee8202070eba63c972d23c56a3a0fbd439c3e4245114e: Status 404 returned error can't find the container with id 26ccd44626ef12efe19ee8202070eba63c972d23c56a3a0fbd439c3e4245114e
Jul 15 19:54:25.517535 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:25.517277    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc737f5ff_71e2_495d_a216_2a475079a6ff.slice/crio-82e7a7494d9e6cc662290d2bdf87b416301f186316be83a59633bdc0db218543 WatchSource:0}: Error finding container 82e7a7494d9e6cc662290d2bdf87b416301f186316be83a59633bdc0db218543: Status 404 returned error can't find the container with id 82e7a7494d9e6cc662290d2bdf87b416301f186316be83a59633bdc0db218543
Jul 15 19:54:25.520290 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:25.519567    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240b2452_aa6d_4036_8696_a2a9b8130697.slice/crio-9fb4be9c45156d41a674085f9962d89e6a1fb3b3db0b7f0724c1456b19d0191b WatchSource:0}: Error finding container 9fb4be9c45156d41a674085f9962d89e6a1fb3b3db0b7f0724c1456b19d0191b: Status 404 returned error can't find the container with id 9fb4be9c45156d41a674085f9962d89e6a1fb3b3db0b7f0724c1456b19d0191b
Jul 15 19:54:25.526512 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.526329    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmns\" (UniqueName: \"kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns\") pod \"network-check-target-k8sd5\" (UID: \"702d07b3-f02e-4d5d-a384-be6d2d534797\") " pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:25.526662 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:25.526642    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:54:25.526712 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:25.526672    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:54:25.526712 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:25.526687    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jsmns for pod openshift-network-diagnostics/network-check-target-k8sd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:25.526786 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:25.526774    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns podName:702d07b3-f02e-4d5d-a384-be6d2d534797 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:26.526749727 +0000 UTC m=+4.163866997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jsmns" (UniqueName: "kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns") pod "network-check-target-k8sd5" (UID: "702d07b3-f02e-4d5d-a384-be6d2d534797") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:25.700751 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.700655    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:54:25.770690 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.770623    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:49:25 +0000 UTC" deadline="2028-05-01 19:41:41.07166186 +0000 UTC"
Jul 15 19:54:25.770690 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.770689    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15743h47m15.300978144s"
Jul 15 19:54:25.890139 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.889426    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:25.890139 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:25.889559    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:25.890139 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.889978    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:25.890139 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:25.890092    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:25.897879 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.897803    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl" event={"ID":"c737f5ff-71e2-495d-a216-2a475079a6ff","Type":"ContainerStarted","Data":"82e7a7494d9e6cc662290d2bdf87b416301f186316be83a59633bdc0db218543"}
Jul 15 19:54:25.899347 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.899318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6sf8b" event={"ID":"c2d28289-371c-4a8f-90d9-445c4717085d","Type":"ContainerStarted","Data":"4f6a0b2b094fe0073b36124d8c4c96663bc9435b370320e7c7df91f2eaa3596a"}
Jul 15 19:54:25.901047 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.901019    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ppbh4" event={"ID":"e16ebf3f-721e-45b8-88f9-9d5749b3c8be","Type":"ContainerStarted","Data":"ef76088328c9595e74eca509611d6d276288ad588dd3be84e0de3dbe23ddefec"}
Jul 15 19:54:25.902692 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.902665    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2mr7m" event={"ID":"79a2509f-740e-4887-a185-47bf2ea1035a","Type":"ContainerStarted","Data":"2f096d6b676ec196f118ec1d821fe0980b7fba5164f50933452159ec79a09719"}
Jul 15 19:54:25.904275 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.904217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ktsf" event={"ID":"539ac057-2627-43ac-af87-9b44e3d25a4f","Type":"ContainerStarted","Data":"b29688f13a50866e399a4b43dd8e3ecc692e79bffc69dfa91c22f4badb3d3ab5"}
Jul 15 19:54:25.906622 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.906583    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8m4j" event={"ID":"e1438ef8-fe0e-4c34-a667-36467bdb520d","Type":"ContainerStarted","Data":"26ccd44626ef12efe19ee8202070eba63c972d23c56a3a0fbd439c3e4245114e"}
Jul 15 19:54:25.908025 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.907914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw" event={"ID":"240b2452-aa6d-4036-8696-a2a9b8130697","Type":"ContainerStarted","Data":"9fb4be9c45156d41a674085f9962d89e6a1fb3b3db0b7f0724c1456b19d0191b"}
Jul 15 19:54:25.909711 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.909685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9gbzl" event={"ID":"70e0d3b8-298c-4cee-be41-9e559fbd3711","Type":"ContainerStarted","Data":"52df837d0c80382c00b9e392b90f03a43f326ab8a42892dabb9926a75b9e3dc1"}
Jul 15 19:54:25.911273 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:25.911247    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lst2f" event={"ID":"285224d2-fbcd-482f-8422-9a328b6e726e","Type":"ContainerStarted","Data":"d0b152a3f9df3b32fd05525a56d72ac023aa1d255146ca56f9ccf7d2a7e3cf63"}
Jul 15 19:54:26.434370 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:26.433517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:26.434370 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:26.433582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:26.434370 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:26.433717    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:26.434370 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:26.433782    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret podName:a59c139c-c5f1-4bc1-9a89-cc09b82663c5 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:28.433762027 +0000 UTC m=+6.070879300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret") pod "global-pull-secret-syncer-npph7" (UID: "a59c139c-c5f1-4bc1-9a89-cc09b82663c5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:26.434370 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:26.434279    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:26.434370 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:26.434336    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs podName:d15aacac-717b-4c46-866c-1c0d823ebd4a nodeName:}" failed. No retries permitted until 2026-07-15 19:54:28.434317801 +0000 UTC m=+6.071435073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs") pod "network-metrics-daemon-vtgkp" (UID: "d15aacac-717b-4c46-866c-1c0d823ebd4a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:26.537360 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:26.536050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmns\" (UniqueName: \"kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns\") pod \"network-check-target-k8sd5\" (UID: \"702d07b3-f02e-4d5d-a384-be6d2d534797\") " pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:26.537360 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:26.536255    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:54:26.537360 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:26.536282    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:54:26.537360 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:26.536296    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jsmns for pod openshift-network-diagnostics/network-check-target-k8sd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:26.537360 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:26.536367    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns podName:702d07b3-f02e-4d5d-a384-be6d2d534797 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:28.536348743 +0000 UTC m=+6.173466014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jsmns" (UniqueName: "kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns") pod "network-check-target-k8sd5" (UID: "702d07b3-f02e-4d5d-a384-be6d2d534797") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:26.771662 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:26.771533    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:49:25 +0000 UTC" deadline="2028-02-01 00:53:21.277861599 +0000 UTC"
Jul 15 19:54:26.771662 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:26.771575    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13564h58m54.506292269s"
Jul 15 19:54:26.892065 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:26.892028    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:26.892248 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:26.892163    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:26.956139 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:26.955133    2560 generic.go:356] "Generic (PLEG): container finished" podID="a988acd2f800074fc02d09d68b87b957" containerID="c67a30ce9dc02c42d6644544a5b4bd648b5b48e0dba1fe163f64987a24d3c160" exitCode=0
Jul 15 19:54:26.956139 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:26.955234    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal" event={"ID":"a988acd2f800074fc02d09d68b87b957","Type":"ContainerDied","Data":"c67a30ce9dc02c42d6644544a5b4bd648b5b48e0dba1fe163f64987a24d3c160"}
Jul 15 19:54:26.967370 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:26.967337    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-197.ec2.internal" event={"ID":"c92467abfb01b67486eb8e097ce3440a","Type":"ContainerStarted","Data":"ccd125a1e813f02561c37937ee555bd2dcfc78dbfa2c0882c4dff53678367e26"}
Jul 15 19:54:27.889754 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:27.889687    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:27.890428 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:27.889841    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:27.890428 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:27.890278    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:27.890428 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:27.890377    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:28.001223 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:28.001121    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal" event={"ID":"a988acd2f800074fc02d09d68b87b957","Type":"ContainerStarted","Data":"29b7e8319a3a18d98d817044d83b6fc5d88add439e364ac6f3d08db05510adc7"}
Jul 15 19:54:28.036276 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:28.035953    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-197.ec2.internal" podStartSLOduration=4.035934853 podStartE2EDuration="4.035934853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:27.011409994 +0000 UTC m=+4.648527288" watchObservedRunningTime="2026-07-15 19:54:28.035934853 +0000 UTC m=+5.673052226"
Jul 15 19:54:28.455240 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:28.455147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:28.455240 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:28.455223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:28.455688 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:28.455360    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:28.455688 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:28.455428    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret podName:a59c139c-c5f1-4bc1-9a89-cc09b82663c5 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:32.455407134 +0000 UTC m=+10.092524408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret") pod "global-pull-secret-syncer-npph7" (UID: "a59c139c-c5f1-4bc1-9a89-cc09b82663c5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:28.456256 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:28.455868    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:28.456256 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:28.455926    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs podName:d15aacac-717b-4c46-866c-1c0d823ebd4a nodeName:}" failed. No retries permitted until 2026-07-15 19:54:32.455909423 +0000 UTC m=+10.093026696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs") pod "network-metrics-daemon-vtgkp" (UID: "d15aacac-717b-4c46-866c-1c0d823ebd4a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:28.555880 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:28.555802    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmns\" (UniqueName: \"kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns\") pod \"network-check-target-k8sd5\" (UID: \"702d07b3-f02e-4d5d-a384-be6d2d534797\") " pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:28.556208 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:28.555990    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:54:28.556208 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:28.556011    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:54:28.556208 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:28.556024    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jsmns for pod openshift-network-diagnostics/network-check-target-k8sd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:28.556410 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:28.556294    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns podName:702d07b3-f02e-4d5d-a384-be6d2d534797 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:32.556263928 +0000 UTC m=+10.193381223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jsmns" (UniqueName: "kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns") pod "network-check-target-k8sd5" (UID: "702d07b3-f02e-4d5d-a384-be6d2d534797") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:28.892058 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:28.891974    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:28.892624 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:28.892137    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:29.889457 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:29.889420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:29.889702 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:29.889580    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:29.890206 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:29.889984    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:29.890206 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:29.890120    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:30.889046 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:30.888969    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:30.889989 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:30.889618    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:31.889133 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:31.889066    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:31.889133 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:31.889126    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:31.889688 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:31.889247    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:31.889840 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:31.889754    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:32.489561 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:32.488840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:32.489561 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:32.488930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:32.489561 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:32.489051    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:32.489561 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:32.489101    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs podName:d15aacac-717b-4c46-866c-1c0d823ebd4a nodeName:}" failed. No retries permitted until 2026-07-15 19:54:40.489087164 +0000 UTC m=+18.126204434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs") pod "network-metrics-daemon-vtgkp" (UID: "d15aacac-717b-4c46-866c-1c0d823ebd4a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:32.489561 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:32.489472    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:32.489561 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:32.489525    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret podName:a59c139c-c5f1-4bc1-9a89-cc09b82663c5 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:40.489509838 +0000 UTC m=+18.126627114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret") pod "global-pull-secret-syncer-npph7" (UID: "a59c139c-c5f1-4bc1-9a89-cc09b82663c5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:32.590081 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:32.589412    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmns\" (UniqueName: \"kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns\") pod \"network-check-target-k8sd5\" (UID: \"702d07b3-f02e-4d5d-a384-be6d2d534797\") " pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:32.590081 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:32.589607    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:54:32.590081 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:32.589628    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:54:32.590081 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:32.589643    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jsmns for pod openshift-network-diagnostics/network-check-target-k8sd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:32.590081 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:32.589702    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns podName:702d07b3-f02e-4d5d-a384-be6d2d534797 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:40.589683909 +0000 UTC m=+18.226801181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jsmns" (UniqueName: "kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns") pod "network-check-target-k8sd5" (UID: "702d07b3-f02e-4d5d-a384-be6d2d534797") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:32.891377 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:32.891294    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:32.891724 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:32.891422    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:33.889149 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:33.889113    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:33.889301 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:33.889242    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:33.889621 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:33.889603    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:33.889754 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:33.889703    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:34.889720 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:34.889239    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:34.889720 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:34.889354    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:35.889574 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:35.889545    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:35.889737 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:35.889644    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:35.889737 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:35.889694    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:35.890055 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:35.889791    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:36.892012 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:36.891978    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:36.892367 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:36.892075    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:37.889160 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:37.889121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:37.889160 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:37.889149    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:37.889364 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:37.889246    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:37.889408 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:37.889360    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:38.889157 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:38.889121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:38.889635 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:38.889245    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:39.889713 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:39.889679    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:39.890217 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:39.889693    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:39.890217 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:39.889789    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:39.890217 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:39.889907    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:40.549212 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:40.549174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:40.549456 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:40.549241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:40.549456 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:40.549358    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:40.549456 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:40.549425    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret podName:a59c139c-c5f1-4bc1-9a89-cc09b82663c5 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:56.549410594 +0000 UTC m=+34.186527862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret") pod "global-pull-secret-syncer-npph7" (UID: "a59c139c-c5f1-4bc1-9a89-cc09b82663c5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:40.549599 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:40.549358    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:40.549599 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:40.549524    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs podName:d15aacac-717b-4c46-866c-1c0d823ebd4a nodeName:}" failed. No retries permitted until 2026-07-15 19:54:56.549504486 +0000 UTC m=+34.186621759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs") pod "network-metrics-daemon-vtgkp" (UID: "d15aacac-717b-4c46-866c-1c0d823ebd4a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:40.650571 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:40.650530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmns\" (UniqueName: \"kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns\") pod \"network-check-target-k8sd5\" (UID: \"702d07b3-f02e-4d5d-a384-be6d2d534797\") " pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:40.650765 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:40.650712    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:54:40.650765 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:40.650743    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:54:40.650765 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:40.650759    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jsmns for pod openshift-network-diagnostics/network-check-target-k8sd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:40.650904 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:40.650813    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns podName:702d07b3-f02e-4d5d-a384-be6d2d534797 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:56.650797497 +0000 UTC m=+34.287914768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jsmns" (UniqueName: "kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns") pod "network-check-target-k8sd5" (UID: "702d07b3-f02e-4d5d-a384-be6d2d534797") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:40.889422 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:40.889339    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:40.889576 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:40.889469    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:41.889132 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:41.889104    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:41.889560 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:41.889103    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:41.889560 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:41.889225    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:41.889560 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:41.889337    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:42.889565 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:42.889529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:42.890063 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:42.889635    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:43.888989 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:43.888954    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:43.889179 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:43.888962    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:43.889179 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:43.889079    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:43.889293 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:43.889182    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:44.889065 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:44.889029    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:44.889563 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:44.889162    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:45.889640 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:45.889285    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:45.890394 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:45.889285    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:45.890394 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:45.889683    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:45.890394 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:45.889735    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:46.046474 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.046432    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl" event={"ID":"c737f5ff-71e2-495d-a216-2a475079a6ff","Type":"ContainerStarted","Data":"5990cb56282a2d23bd98bfb51c2c0e152f24f72c65caed1db302e5119f11e96d"}
Jul 15 19:54:46.048250 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.048215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6sf8b" event={"ID":"c2d28289-371c-4a8f-90d9-445c4717085d","Type":"ContainerStarted","Data":"00d1787d7145caec1f545bb094ba5259ef3cfb9a538f23dad29f9a65f93be361"}
Jul 15 19:54:46.050169 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.050137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2mr7m" event={"ID":"79a2509f-740e-4887-a185-47bf2ea1035a","Type":"ContainerStarted","Data":"abee3184fc9a5775f5f223335c4ef12c35833da986b6f267dd296ddce3dfc38d"}
Jul 15 19:54:46.051826 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.051801    2560 generic.go:356] "Generic (PLEG): container finished" podID="539ac057-2627-43ac-af87-9b44e3d25a4f" containerID="8ca2d8a772bed7ed19a5f11dd2de8bc13d392b9b19515043f1de686738fa1c11" exitCode=0
Jul 15 19:54:46.051954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.051884    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ktsf" event={"ID":"539ac057-2627-43ac-af87-9b44e3d25a4f","Type":"ContainerDied","Data":"8ca2d8a772bed7ed19a5f11dd2de8bc13d392b9b19515043f1de686738fa1c11"}
Jul 15 19:54:46.053433 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.053400    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8m4j" event={"ID":"e1438ef8-fe0e-4c34-a667-36467bdb520d","Type":"ContainerStarted","Data":"5b43ea645b7d6ef6d253d991c656b9e7a9ec1e9db4fd76954546fc7ffb00d0a8"}
Jul 15 19:54:46.056741 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.056723    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 19:54:46.057111 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.057089    2560 generic.go:356] "Generic (PLEG): container finished" podID="240b2452-aa6d-4036-8696-a2a9b8130697" containerID="7e13a767659c030d5622b6b9c6a462db9dffaf67fbabe505272e93b0ccba5c1f" exitCode=1
Jul 15 19:54:46.057252 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.057160    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw" event={"ID":"240b2452-aa6d-4036-8696-a2a9b8130697","Type":"ContainerStarted","Data":"7133268115abbe167d9a268591b3eaefeb13f1572244dfb69c9607faf3066b09"}
Jul 15 19:54:46.057252 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.057226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw" event={"ID":"240b2452-aa6d-4036-8696-a2a9b8130697","Type":"ContainerStarted","Data":"d99c7a012a69a05a1e5f6fa4f1050c9a8c90f1c2a98c40ae4367c253abc93b0c"}
Jul 15 19:54:46.057367 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.057279    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw" event={"ID":"240b2452-aa6d-4036-8696-a2a9b8130697","Type":"ContainerStarted","Data":"c27cd97d1d73bf454c57121f06cb96704f9499f9e7546db450e516c6adfd5cc3"}
Jul 15 19:54:46.057367 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.057329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw" event={"ID":"240b2452-aa6d-4036-8696-a2a9b8130697","Type":"ContainerStarted","Data":"32d35931be490ec83e29d9939bd549c93a40414993a124fca49d83cfbe990235"}
Jul 15 19:54:46.057515 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.057380    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw" event={"ID":"240b2452-aa6d-4036-8696-a2a9b8130697","Type":"ContainerDied","Data":"7e13a767659c030d5622b6b9c6a462db9dffaf67fbabe505272e93b0ccba5c1f"}
Jul 15 19:54:46.057515 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.057430    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw" event={"ID":"240b2452-aa6d-4036-8696-a2a9b8130697","Type":"ContainerStarted","Data":"d49a3cf5e4da25aaf41aab2873163a80e0c048dc4ad5bdb9c7a8c5d9d7899bbb"}
Jul 15 19:54:46.058578 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.058560    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9gbzl" event={"ID":"70e0d3b8-298c-4cee-be41-9e559fbd3711","Type":"ContainerStarted","Data":"1ac292caad801cca2a800d36cd1c9ffe3ca4a7cdc72d784480c4455f09a977b8"}
Jul 15 19:54:46.059924 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.059902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lst2f" event={"ID":"285224d2-fbcd-482f-8422-9a328b6e726e","Type":"ContainerStarted","Data":"0a0547e4961ca4dbb201c8f7b787e69784c1c6bc12905aaec72b2037eb59cbcb"}
Jul 15 19:54:46.066412 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.066366    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6sf8b" podStartSLOduration=3.645563257 podStartE2EDuration="23.066350462s" totalImagesPullingTime="19.420787205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:46.066149262 +0000 UTC m=+23.703266544" watchObservedRunningTime="2026-07-15 19:54:46.066350462 +0000 UTC m=+23.703467756"
Jul 15 19:54:46.066531 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.066498    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-197.ec2.internal" podStartSLOduration=22.066491897 podStartE2EDuration="22.066491897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:28.041106286 +0000 UTC m=+5.678223582" watchObservedRunningTime="2026-07-15 19:54:46.066491897 +0000 UTC m=+23.703609193"
Jul 15 19:54:46.082915 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.082873    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lst2f" podStartSLOduration=3.659939268 podStartE2EDuration="23.08286052s" totalImagesPullingTime="19.422921252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:46.082634278 +0000 UTC m=+23.719751569" watchObservedRunningTime="2026-07-15 19:54:46.08286052 +0000 UTC m=+23.719977809"
Jul 15 19:54:46.099154 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.099109    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9gbzl" podStartSLOduration=3.67688822 podStartE2EDuration="23.099094856s" totalImagesPullingTime="19.422206636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:46.099063732 +0000 UTC m=+23.736181023" watchObservedRunningTime="2026-07-15 19:54:46.099094856 +0000 UTC m=+23.736212146"
Jul 15 19:54:46.119176 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.119138    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2mr7m" podStartSLOduration=3.260533719 podStartE2EDuration="23.119126014s" totalImagesPullingTime="19.858592295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:46.118655435 +0000 UTC m=+23.755772725" watchObservedRunningTime="2026-07-15 19:54:46.119126014 +0000 UTC m=+23.756243304"
Jul 15 19:54:46.137879 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.137848    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h8m4j" podStartSLOduration=3.723733635 podStartE2EDuration="23.137836009s" totalImagesPullingTime="19.414102374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:46.13782141 +0000 UTC m=+23.774938699" watchObservedRunningTime="2026-07-15 19:54:46.137836009 +0000 UTC m=+23.774953298"
Jul 15 19:54:46.711633 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.711609    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 19:54:46.773495 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.773347    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T19:54:46.711628203Z","UUID":"06136bf3-f3f1-4818-b3fe-b6b65b0a9609","Handler":null,"Name":"","Endpoint":""}
Jul 15 19:54:46.774806 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.774776    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 19:54:46.774912 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.774813    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 19:54:46.889242 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:46.889164    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:46.889423 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:46.889292    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:47.064070 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:47.064027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl" event={"ID":"c737f5ff-71e2-495d-a216-2a475079a6ff","Type":"ContainerStarted","Data":"32988c933951d4aa8f25eb0738976d0ca4d60ffb6b748f36ea1d967844f0254d"}
Jul 15 19:54:47.065640 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:47.065612    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ppbh4" event={"ID":"e16ebf3f-721e-45b8-88f9-9d5749b3c8be","Type":"ContainerStarted","Data":"c2cf5925f3fa99c2effae30f61deb1382c3a5afc3010bdd6319d7b1b0906851e"}
Jul 15 19:54:47.088031 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:47.085589    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ppbh4" podStartSLOduration=4.656802387 podStartE2EDuration="24.085571022s" totalImagesPullingTime="19.428768635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:47.084705635 +0000 UTC m=+24.721822926" watchObservedRunningTime="2026-07-15 19:54:47.085571022 +0000 UTC m=+24.722688313"
Jul 15 19:54:47.889161 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:47.888989    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:47.889313 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:47.889029    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:47.889313 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:47.889235    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:47.889388 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:47.889309    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:47.934339 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:47.934307    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lst2f"
Jul 15 19:54:48.070294 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:48.070271    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 19:54:48.070820 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:48.070791    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw" event={"ID":"240b2452-aa6d-4036-8696-a2a9b8130697","Type":"ContainerStarted","Data":"47eff1d4311c4facf98c8608d45f4f40288985b43d89b0eb1ed12948f2758e09"}
Jul 15 19:54:48.592565 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:48.592535    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lst2f"
Jul 15 19:54:48.593237 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:48.593207    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lst2f"
Jul 15 19:54:48.889537 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:48.889509    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:48.889700 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:48.889598    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:49.075734 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:49.075699    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl" event={"ID":"c737f5ff-71e2-495d-a216-2a475079a6ff","Type":"ContainerStarted","Data":"5ede49a91b88db9eb9c2e00cc95ddd87fbd45718150da10283632d505282ffb6"}
Jul 15 19:54:49.076533 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:49.076507    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lst2f"
Jul 15 19:54:49.099311 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:49.099271    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dpgl" podStartSLOduration=3.975685142 podStartE2EDuration="26.099251832s" totalImagesPullingTime="22.12356669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:54:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:49.099010565 +0000 UTC m=+26.736127876" watchObservedRunningTime="2026-07-15 19:54:49.099251832 +0000 UTC m=+26.736369123"
Jul 15 19:54:49.889482 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:49.889452    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:49.889629 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:49.889487    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:49.889629 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:49.889592    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:49.889730 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:49.889654    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:50.889092 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:50.888906    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:50.889584 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:50.889172    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:51.081245 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:51.081176    2560 generic.go:356] "Generic (PLEG): container finished" podID="539ac057-2627-43ac-af87-9b44e3d25a4f" containerID="fb23b99362787950db449f9d154650ce79b94a7ad17a20ab6756d5d8782cc2d3" exitCode=0
Jul 15 19:54:51.081405 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:51.081265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ktsf" event={"ID":"539ac057-2627-43ac-af87-9b44e3d25a4f","Type":"ContainerDied","Data":"fb23b99362787950db449f9d154650ce79b94a7ad17a20ab6756d5d8782cc2d3"}
Jul 15 19:54:51.084445 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:51.084428    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 19:54:51.084759 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:51.084740    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw" event={"ID":"240b2452-aa6d-4036-8696-a2a9b8130697","Type":"ContainerStarted","Data":"0a97773842e16c69f7f5bb3402d13b97073c8283390ff9d3fd8d8b33034501c6"}
Jul 15 19:54:51.085071 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:51.085056    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:51.085243 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:51.085218    2560 scope.go:117] "RemoveContainer" containerID="7e13a767659c030d5622b6b9c6a462db9dffaf67fbabe505272e93b0ccba5c1f"
Jul 15 19:54:51.101019 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:51.101001    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:51.380606 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:51.380582    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:51.889518 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:51.889481    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:51.890108 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:51.889625    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:51.890108 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:51.890001    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:51.890108 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:51.890087    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:52.091086 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:52.091060    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 19:54:52.091426 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:52.091398    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw" event={"ID":"240b2452-aa6d-4036-8696-a2a9b8130697","Type":"ContainerStarted","Data":"2edf1a2ee0bd15dd05dbbe14046e91aa5f65acf7eec4d5121fda9be6b1209772"}
Jul 15 19:54:52.091708 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:52.091685    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:52.107438 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:52.107416    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:54:52.228572 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:52.228531    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw" podStartSLOduration=9.750577528 podStartE2EDuration="29.228516519s" totalImagesPullingTime="19.477938991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:52.157540067 +0000 UTC m=+29.794657356" watchObservedRunningTime="2026-07-15 19:54:52.228516519 +0000 UTC m=+29.865633810"
Jul 15 19:54:52.773144 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:52.773113    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vtgkp"]
Jul 15 19:54:52.773299 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:52.773253    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:52.773369 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:52.773348    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:52.783505 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:52.783480    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k8sd5"]
Jul 15 19:54:52.783636 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:52.783567    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:52.783703 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:52.783633    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:52.803688 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:52.803628    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-npph7"]
Jul 15 19:54:52.803838 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:52.803710    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:52.803838 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:52.803777    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:53.096138 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:53.096112    2560 generic.go:356] "Generic (PLEG): container finished" podID="539ac057-2627-43ac-af87-9b44e3d25a4f" containerID="ad05d3faef1ded7c2262a351770733dc8da20f3ff0a1999b46cc955c1603d1e3" exitCode=0
Jul 15 19:54:53.096567 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:53.096193    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ktsf" event={"ID":"539ac057-2627-43ac-af87-9b44e3d25a4f","Type":"ContainerDied","Data":"ad05d3faef1ded7c2262a351770733dc8da20f3ff0a1999b46cc955c1603d1e3"}
Jul 15 19:54:53.889096 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:53.889070    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:53.889263 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:53.889178    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:54.889511 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:54.889428    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:54.889511 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:54.889477    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:54.890250 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:54.889595    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:54.890250 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:54.889691    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:55.103309 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:55.103273    2560 generic.go:356] "Generic (PLEG): container finished" podID="539ac057-2627-43ac-af87-9b44e3d25a4f" containerID="a2653571870129c7c789ee267191930eb75ed3ee71325bd7b469df5d71d3a5fe" exitCode=0
Jul 15 19:54:55.103460 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:55.103315    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ktsf" event={"ID":"539ac057-2627-43ac-af87-9b44e3d25a4f","Type":"ContainerDied","Data":"a2653571870129c7c789ee267191930eb75ed3ee71325bd7b469df5d71d3a5fe"}
Jul 15 19:54:55.889518 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:55.889480    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:55.889919 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:55.889596    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vtgkp" podUID="d15aacac-717b-4c46-866c-1c0d823ebd4a"
Jul 15 19:54:56.576366 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:56.576328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:56.576553 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:56.576397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:56.576553 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:56.576496    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:56.576553 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:56.576514    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:56.576553 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:56.576554    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs podName:d15aacac-717b-4c46-866c-1c0d823ebd4a nodeName:}" failed. No retries permitted until 2026-07-15 19:55:28.576534127 +0000 UTC m=+66.213651419 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs") pod "network-metrics-daemon-vtgkp" (UID: "d15aacac-717b-4c46-866c-1c0d823ebd4a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:54:56.576717 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:56.576578    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret podName:a59c139c-c5f1-4bc1-9a89-cc09b82663c5 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:28.576561027 +0000 UTC m=+66.213678307 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret") pod "global-pull-secret-syncer-npph7" (UID: "a59c139c-c5f1-4bc1-9a89-cc09b82663c5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:54:56.677046 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:56.677013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmns\" (UniqueName: \"kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns\") pod \"network-check-target-k8sd5\" (UID: \"702d07b3-f02e-4d5d-a384-be6d2d534797\") " pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:56.677208 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:56.677185    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:54:56.677208 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:56.677204    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:54:56.677302 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:56.677213    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jsmns for pod openshift-network-diagnostics/network-check-target-k8sd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:56.677302 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:56.677264    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns podName:702d07b3-f02e-4d5d-a384-be6d2d534797 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:28.677249872 +0000 UTC m=+66.314367149 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jsmns" (UniqueName: "kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns") pod "network-check-target-k8sd5" (UID: "702d07b3-f02e-4d5d-a384-be6d2d534797") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:54:56.889151 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:56.889117    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:56.889353 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:56.889124    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:56.889353 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:56.889267    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sd5" podUID="702d07b3-f02e-4d5d-a384-be6d2d534797"
Jul 15 19:54:56.889353 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:56.889333    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-npph7" podUID="a59c139c-c5f1-4bc1-9a89-cc09b82663c5"
Jul 15 19:54:57.736293 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.736230    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-197.ec2.internal" event="NodeReady"
Jul 15 19:54:57.736626 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.736360    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 19:54:57.858438 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.858410    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v8qbh"]
Jul 15 19:54:57.860661 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.860642    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v8qbh"
Jul 15 19:54:57.876452 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.876433    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 19:54:57.879916 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.879892    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 19:54:57.880108 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.879895    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 19:54:57.880757 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.880739    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zbcvf\""
Jul 15 19:54:57.889101 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.889084    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:54:57.895221 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.894402    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m8n8f"]
Jul 15 19:54:57.895526 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.895509    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 19:54:57.896502 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.896482    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:57.900279 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.900259    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 19:54:57.901310 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.901287    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 19:54:57.902176 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.902155    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c5qnq\""
Jul 15 19:54:57.907128 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.907104    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v8qbh"]
Jul 15 19:54:57.916546 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.916526    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sjg99\""
Jul 15 19:54:57.963425 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.963395    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m8n8f"]
Jul 15 19:54:57.987682 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.987603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36995e4c-2a4b-4381-8c3d-0f515a4112af-cert\") pod \"ingress-canary-v8qbh\" (UID: \"36995e4c-2a4b-4381-8c3d-0f515a4112af\") " pod="openshift-ingress-canary/ingress-canary-v8qbh"
Jul 15 19:54:57.987682 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:57.987638    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6pjf\" (UniqueName: \"kubernetes.io/projected/36995e4c-2a4b-4381-8c3d-0f515a4112af-kube-api-access-t6pjf\") pod \"ingress-canary-v8qbh\" (UID: \"36995e4c-2a4b-4381-8c3d-0f515a4112af\") " pod="openshift-ingress-canary/ingress-canary-v8qbh"
Jul 15 19:54:58.089007 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.088976    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36995e4c-2a4b-4381-8c3d-0f515a4112af-cert\") pod \"ingress-canary-v8qbh\" (UID: \"36995e4c-2a4b-4381-8c3d-0f515a4112af\") " pod="openshift-ingress-canary/ingress-canary-v8qbh"
Jul 15 19:54:58.089007 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.089008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6pjf\" (UniqueName: \"kubernetes.io/projected/36995e4c-2a4b-4381-8c3d-0f515a4112af-kube-api-access-t6pjf\") pod \"ingress-canary-v8qbh\" (UID: \"36995e4c-2a4b-4381-8c3d-0f515a4112af\") " pod="openshift-ingress-canary/ingress-canary-v8qbh"
Jul 15 19:54:58.089184 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.089035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f46a85b1-9906-48b0-b399-ece5b1699802-tmp-dir\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:58.089184 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.089080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f46a85b1-9906-48b0-b399-ece5b1699802-config-volume\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:58.089184 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.089153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-484sd\" (UniqueName: \"kubernetes.io/projected/f46a85b1-9906-48b0-b399-ece5b1699802-kube-api-access-484sd\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:58.089184 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.089181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:58.093864 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.093701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36995e4c-2a4b-4381-8c3d-0f515a4112af-cert\") pod \"ingress-canary-v8qbh\" (UID: \"36995e4c-2a4b-4381-8c3d-0f515a4112af\") " pod="openshift-ingress-canary/ingress-canary-v8qbh"
Jul 15 19:54:58.101118 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.101099    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6pjf\" (UniqueName: \"kubernetes.io/projected/36995e4c-2a4b-4381-8c3d-0f515a4112af-kube-api-access-t6pjf\") pod \"ingress-canary-v8qbh\" (UID: \"36995e4c-2a4b-4381-8c3d-0f515a4112af\") " pod="openshift-ingress-canary/ingress-canary-v8qbh"
Jul 15 19:54:58.171401 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.171366    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v8qbh"
Jul 15 19:54:58.189762 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.189731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f46a85b1-9906-48b0-b399-ece5b1699802-tmp-dir\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:58.189903 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.189793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f46a85b1-9906-48b0-b399-ece5b1699802-config-volume\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:58.189903 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.189877    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-484sd\" (UniqueName: \"kubernetes.io/projected/f46a85b1-9906-48b0-b399-ece5b1699802-kube-api-access-484sd\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:58.190020 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.189905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:58.190056 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:58.190048    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:54:58.190152 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:58.190109    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls podName:f46a85b1-9906-48b0-b399-ece5b1699802 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:58.690089935 +0000 UTC m=+36.327207257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls") pod "dns-default-m8n8f" (UID: "f46a85b1-9906-48b0-b399-ece5b1699802") : secret "dns-default-metrics-tls" not found
Jul 15 19:54:58.190152 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.190126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f46a85b1-9906-48b0-b399-ece5b1699802-tmp-dir\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:58.190375 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.190356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f46a85b1-9906-48b0-b399-ece5b1699802-config-volume\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:58.221831 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.221802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-484sd\" (UniqueName: \"kubernetes.io/projected/f46a85b1-9906-48b0-b399-ece5b1699802-kube-api-access-484sd\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:58.694200 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.694158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:58.694376 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:58.694301    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:54:58.694376 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:58.694365    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls podName:f46a85b1-9906-48b0-b399-ece5b1699802 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:59.694349387 +0000 UTC m=+37.331466665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls") pod "dns-default-m8n8f" (UID: "f46a85b1-9906-48b0-b399-ece5b1699802") : secret "dns-default-metrics-tls" not found
Jul 15 19:54:58.889008 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.888973    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:54:58.889429 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.889228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:54:58.899234 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.899212    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 19:54:58.899378 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.899288    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 19:54:58.900241 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.900218    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q7pb7\""
Jul 15 19:54:58.900353 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:58.900307    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 19:54:59.389333 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:59.389298    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v8qbh"]
Jul 15 19:54:59.393603 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:54:59.393576    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36995e4c_2a4b_4381_8c3d_0f515a4112af.slice/crio-7cc19cb617d37caa3157ceb8c0a33038eb8f13b250ab951f61f648a01554b6f3 WatchSource:0}: Error finding container 7cc19cb617d37caa3157ceb8c0a33038eb8f13b250ab951f61f648a01554b6f3: Status 404 returned error can't find the container with id 7cc19cb617d37caa3157ceb8c0a33038eb8f13b250ab951f61f648a01554b6f3
Jul 15 19:54:59.701065 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:54:59.701024    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:54:59.701216 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:59.701152    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:54:59.701216 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:54:59.701213    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls podName:f46a85b1-9906-48b0-b399-ece5b1699802 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:01.701199517 +0000 UTC m=+39.338316784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls") pod "dns-default-m8n8f" (UID: "f46a85b1-9906-48b0-b399-ece5b1699802") : secret "dns-default-metrics-tls" not found
Jul 15 19:55:00.118313 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:00.118281    2560 generic.go:356] "Generic (PLEG): container finished" podID="539ac057-2627-43ac-af87-9b44e3d25a4f" containerID="d1a29985191c4a8d0f6a1b3dbacad1a639626fac38e7d25d32c69257938a9424" exitCode=0
Jul 15 19:55:00.118679 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:00.118347    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ktsf" event={"ID":"539ac057-2627-43ac-af87-9b44e3d25a4f","Type":"ContainerDied","Data":"d1a29985191c4a8d0f6a1b3dbacad1a639626fac38e7d25d32c69257938a9424"}
Jul 15 19:55:00.119488 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:00.119466    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v8qbh" event={"ID":"36995e4c-2a4b-4381-8c3d-0f515a4112af","Type":"ContainerStarted","Data":"7cc19cb617d37caa3157ceb8c0a33038eb8f13b250ab951f61f648a01554b6f3"}
Jul 15 19:55:01.126034 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:01.125770    2560 generic.go:356] "Generic (PLEG): container finished" podID="539ac057-2627-43ac-af87-9b44e3d25a4f" containerID="b3ecd07ea12265783e27fe72180c1db864850c7268025a371b9e2fc80a360068" exitCode=0
Jul 15 19:55:01.126034 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:01.125796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ktsf" event={"ID":"539ac057-2627-43ac-af87-9b44e3d25a4f","Type":"ContainerDied","Data":"b3ecd07ea12265783e27fe72180c1db864850c7268025a371b9e2fc80a360068"}
Jul 15 19:55:01.716188 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:01.716143    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:55:01.716356 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:01.716312    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:55:01.716408 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:01.716381    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls podName:f46a85b1-9906-48b0-b399-ece5b1699802 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:05.716366062 +0000 UTC m=+43.353483329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls") pod "dns-default-m8n8f" (UID: "f46a85b1-9906-48b0-b399-ece5b1699802") : secret "dns-default-metrics-tls" not found
Jul 15 19:55:02.131759 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:02.131729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ktsf" event={"ID":"539ac057-2627-43ac-af87-9b44e3d25a4f","Type":"ContainerStarted","Data":"e85ef616f18dd2f92b739d68a6486a3b14a20a925fad9b5254e49c749dacb4e3"}
Jul 15 19:55:03.135093 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:03.135052    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v8qbh" event={"ID":"36995e4c-2a4b-4381-8c3d-0f515a4112af","Type":"ContainerStarted","Data":"e9ae463951115e04f850ca501a1187264aa2319ff9cd69fe35e1cb7cdb37b0d5"}
Jul 15 19:55:03.168024 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:03.167960    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v8qbh" podStartSLOduration=3.272797104 podStartE2EDuration="6.167921775s" totalImagesPullingTime="2.895124671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:03.166768712 +0000 UTC m=+40.803886002" watchObservedRunningTime="2026-07-15 19:55:03.167921775 +0000 UTC m=+40.805039066"
Jul 15 19:55:03.168198 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:03.168180    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5ktsf" podStartSLOduration=9.342889122 podStartE2EDuration="40.168172666s" totalImagesPullingTime="30.825283544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:54:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:02.202906166 +0000 UTC m=+39.840023457" watchObservedRunningTime="2026-07-15 19:55:03.168172666 +0000 UTC m=+40.805289956"
Jul 15 19:55:05.743342 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:05.743300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:55:05.743852 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:05.743434    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:55:05.743852 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:05.743497    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls podName:f46a85b1-9906-48b0-b399-ece5b1699802 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:13.743483069 +0000 UTC m=+51.380600337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls") pod "dns-default-m8n8f" (UID: "f46a85b1-9906-48b0-b399-ece5b1699802") : secret "dns-default-metrics-tls" not found
Jul 15 19:55:13.799010 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:13.798975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:55:13.799446 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:13.799105    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:55:13.799446 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:13.799158    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls podName:f46a85b1-9906-48b0-b399-ece5b1699802 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:29.799143413 +0000 UTC m=+67.436260681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls") pod "dns-default-m8n8f" (UID: "f46a85b1-9906-48b0-b399-ece5b1699802") : secret "dns-default-metrics-tls" not found
Jul 15 19:55:24.116408 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:24.116375    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2g2mw"
Jul 15 19:55:28.599774 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:28.599722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:55:28.600289 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:28.599798    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:55:28.603166 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:28.603147    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 19:55:28.603242 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:28.603227    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 19:55:28.610497 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:28.610477    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 19:55:28.610543 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:28.610534    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs podName:d15aacac-717b-4c46-866c-1c0d823ebd4a nodeName:}" failed. No retries permitted until 2026-07-15 19:56:32.610517506 +0000 UTC m=+130.247634773 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs") pod "network-metrics-daemon-vtgkp" (UID: "d15aacac-717b-4c46-866c-1c0d823ebd4a") : secret "metrics-daemon-secret" not found
Jul 15 19:55:28.613920 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:28.613892    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a59c139c-c5f1-4bc1-9a89-cc09b82663c5-original-pull-secret\") pod \"global-pull-secret-syncer-npph7\" (UID: \"a59c139c-c5f1-4bc1-9a89-cc09b82663c5\") " pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:55:28.700508 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:28.700464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmns\" (UniqueName: \"kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns\") pod \"network-check-target-k8sd5\" (UID: \"702d07b3-f02e-4d5d-a384-be6d2d534797\") " pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:55:28.703723 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:28.703702    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 19:55:28.713774 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:28.713750    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 19:55:28.723679 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:28.723656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsmns\" (UniqueName: \"kubernetes.io/projected/702d07b3-f02e-4d5d-a384-be6d2d534797-kube-api-access-jsmns\") pod \"network-check-target-k8sd5\" (UID: \"702d07b3-f02e-4d5d-a384-be6d2d534797\") " pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:55:28.903240 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:28.903165    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q7pb7\""
Jul 15 19:55:28.909298 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:28.909281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-npph7"
Jul 15 19:55:28.911372 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:28.911353    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:55:29.044381 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:29.044358    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k8sd5"]
Jul 15 19:55:29.046918 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:55:29.046895    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod702d07b3_f02e_4d5d_a384_be6d2d534797.slice/crio-29e8a3b9e4a190774540ea36c923c5f7c0414a47a73cf54758cf418985a7b4ee WatchSource:0}: Error finding container 29e8a3b9e4a190774540ea36c923c5f7c0414a47a73cf54758cf418985a7b4ee: Status 404 returned error can't find the container with id 29e8a3b9e4a190774540ea36c923c5f7c0414a47a73cf54758cf418985a7b4ee
Jul 15 19:55:29.059465 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:29.059437    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-npph7"]
Jul 15 19:55:29.062138 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:55:29.062115    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59c139c_c5f1_4bc1_9a89_cc09b82663c5.slice/crio-2d5c53a54c7b80a0a528d6ab7f777a857f9bc367b29a6489b6730387ebbc91c1 WatchSource:0}: Error finding container 2d5c53a54c7b80a0a528d6ab7f777a857f9bc367b29a6489b6730387ebbc91c1: Status 404 returned error can't find the container with id 2d5c53a54c7b80a0a528d6ab7f777a857f9bc367b29a6489b6730387ebbc91c1
Jul 15 19:55:29.198177 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:29.198087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k8sd5" event={"ID":"702d07b3-f02e-4d5d-a384-be6d2d534797","Type":"ContainerStarted","Data":"29e8a3b9e4a190774540ea36c923c5f7c0414a47a73cf54758cf418985a7b4ee"}
Jul 15 19:55:29.199158 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:29.199127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-npph7" event={"ID":"a59c139c-c5f1-4bc1-9a89-cc09b82663c5","Type":"ContainerStarted","Data":"2d5c53a54c7b80a0a528d6ab7f777a857f9bc367b29a6489b6730387ebbc91c1"}
Jul 15 19:55:29.807794 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:29.807767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:55:29.808301 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:29.807912    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:55:29.808301 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:29.808001    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls podName:f46a85b1-9906-48b0-b399-ece5b1699802 nodeName:}" failed. No retries permitted until 2026-07-15 19:56:01.80797861 +0000 UTC m=+99.445095880 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls") pod "dns-default-m8n8f" (UID: "f46a85b1-9906-48b0-b399-ece5b1699802") : secret "dns-default-metrics-tls" not found
Jul 15 19:55:34.120159 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.119859    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"]
Jul 15 19:55:34.122425 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.122403    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"
Jul 15 19:55:34.133358 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.133337    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"]
Jul 15 19:55:34.134775 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.134589    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:55:34.134775 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.134589    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 19:55:34.134956 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.134777    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zbmqv\""
Jul 15 19:55:34.135248 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.135218    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:34.136708 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.136684    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 19:55:34.137830 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.137808    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"]
Jul 15 19:55:34.144829 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.144809    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-d6w82\""
Jul 15 19:55:34.144949 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.144850    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 19:55:34.145043 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.145028    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 19:55:34.145558 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.145539    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:55:34.154794 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.154776    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 19:55:34.185144 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.185096    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"]
Jul 15 19:55:34.215258 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.215223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k8sd5" event={"ID":"702d07b3-f02e-4d5d-a384-be6d2d534797","Type":"ContainerStarted","Data":"72e66fa423e6ea933be6b7bf48266dfea6a2570f162a7d4b6aa7c7886d3e9287"}
Jul 15 19:55:34.215422 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.215289    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:55:34.216739 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.216709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-npph7" event={"ID":"a59c139c-c5f1-4bc1-9a89-cc09b82663c5","Type":"ContainerStarted","Data":"007c123b7df6aaaaeea1905a3b5dbed825793c20826ca668957782bd4f268955"}
Jul 15 19:55:34.237145 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.237123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xz9cz\" (UID: \"7beb2059-52a2-4a73-8a30-500f99e04d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:34.237273 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.237149    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tntzs\" (UniqueName: \"kubernetes.io/projected/12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2-kube-api-access-tntzs\") pod \"kube-storage-version-migrator-operator-799cb7f958-wswf5\" (UID: \"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"
Jul 15 19:55:34.237273 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.237193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-wswf5\" (UID: \"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"
Jul 15 19:55:34.237273 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.237256    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9fkr\" (UniqueName: \"kubernetes.io/projected/7beb2059-52a2-4a73-8a30-500f99e04d89-kube-api-access-g9fkr\") pod \"cluster-samples-operator-65db858894-xz9cz\" (UID: \"7beb2059-52a2-4a73-8a30-500f99e04d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:34.237412 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.237298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-wswf5\" (UID: \"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"
Jul 15 19:55:34.254866 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.254840    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7fkxh"]
Jul 15 19:55:34.259268 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.259244    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.264374 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.264352    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 19:55:34.264545 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.264527    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zkhkt\""
Jul 15 19:55:34.264600 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.264590    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 19:55:34.265373 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.265357    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 19:55:34.265499 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.265467    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 19:55:34.272156 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.272136    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 19:55:34.277684 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.277667    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7fkxh"]
Jul 15 19:55:34.280521 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.280445    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k8sd5" podStartSLOduration=66.242146094 podStartE2EDuration="1m11.280431721s" totalImagesPullingTime="5.038285627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:34.280338377 +0000 UTC m=+71.917455667" watchObservedRunningTime="2026-07-15 19:55:34.280431721 +0000 UTC m=+71.917549014"
Jul 15 19:55:34.338272 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.338193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-wswf5\" (UID: \"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"
Jul 15 19:55:34.338272 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.338230    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90357708-bc2c-41b6-bbe1-13c770dbe384-tmp\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.338471 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.338278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9fkr\" (UniqueName: \"kubernetes.io/projected/7beb2059-52a2-4a73-8a30-500f99e04d89-kube-api-access-g9fkr\") pod \"cluster-samples-operator-65db858894-xz9cz\" (UID: \"7beb2059-52a2-4a73-8a30-500f99e04d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:34.338471 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.338310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-wswf5\" (UID: \"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"
Jul 15 19:55:34.338471 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.338333    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90357708-bc2c-41b6-bbe1-13c770dbe384-snapshots\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.338471 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.338396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90357708-bc2c-41b6-bbe1-13c770dbe384-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.338471 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.338420    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90357708-bc2c-41b6-bbe1-13c770dbe384-serving-cert\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.338688 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.338479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xz9cz\" (UID: \"7beb2059-52a2-4a73-8a30-500f99e04d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:34.338688 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.338510    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tntzs\" (UniqueName: \"kubernetes.io/projected/12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2-kube-api-access-tntzs\") pod \"kube-storage-version-migrator-operator-799cb7f958-wswf5\" (UID: \"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"
Jul 15 19:55:34.338688 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.338534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90357708-bc2c-41b6-bbe1-13c770dbe384-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.338688 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:34.338538    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 19:55:34.338688 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.338567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k98t4\" (UniqueName: \"kubernetes.io/projected/90357708-bc2c-41b6-bbe1-13c770dbe384-kube-api-access-k98t4\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.338688 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:34.338616    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls podName:7beb2059-52a2-4a73-8a30-500f99e04d89 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:34.838595899 +0000 UTC m=+72.475713188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls") pod "cluster-samples-operator-65db858894-xz9cz" (UID: "7beb2059-52a2-4a73-8a30-500f99e04d89") : secret "samples-operator-tls" not found
Jul 15 19:55:34.338973 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.338788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-wswf5\" (UID: \"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"
Jul 15 19:55:34.340903 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.340879    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-wswf5\" (UID: \"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"
Jul 15 19:55:34.341210 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.341172    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-npph7" podStartSLOduration=66.317154401 podStartE2EDuration="1m11.341159308s" totalImagesPullingTime="5.024004907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:34.34087475 +0000 UTC m=+71.977992040" watchObservedRunningTime="2026-07-15 19:55:34.341159308 +0000 UTC m=+71.978276589"
Jul 15 19:55:34.361238 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.361208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9fkr\" (UniqueName: \"kubernetes.io/projected/7beb2059-52a2-4a73-8a30-500f99e04d89-kube-api-access-g9fkr\") pod \"cluster-samples-operator-65db858894-xz9cz\" (UID: \"7beb2059-52a2-4a73-8a30-500f99e04d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:34.384336 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.384310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tntzs\" (UniqueName: \"kubernetes.io/projected/12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2-kube-api-access-tntzs\") pod \"kube-storage-version-migrator-operator-799cb7f958-wswf5\" (UID: \"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"
Jul 15 19:55:34.439654 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.439624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90357708-bc2c-41b6-bbe1-13c770dbe384-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.439654 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.439655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k98t4\" (UniqueName: \"kubernetes.io/projected/90357708-bc2c-41b6-bbe1-13c770dbe384-kube-api-access-k98t4\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.439824 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.439782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90357708-bc2c-41b6-bbe1-13c770dbe384-tmp\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.439869 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.439843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90357708-bc2c-41b6-bbe1-13c770dbe384-snapshots\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.439917 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.439870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90357708-bc2c-41b6-bbe1-13c770dbe384-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.439917 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.439894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90357708-bc2c-41b6-bbe1-13c770dbe384-serving-cert\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.440173 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.440150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90357708-bc2c-41b6-bbe1-13c770dbe384-tmp\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.440509 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.440469    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90357708-bc2c-41b6-bbe1-13c770dbe384-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.440581 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.440506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90357708-bc2c-41b6-bbe1-13c770dbe384-snapshots\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.440654 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.440637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90357708-bc2c-41b6-bbe1-13c770dbe384-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.442202 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.442181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90357708-bc2c-41b6-bbe1-13c770dbe384-serving-cert\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.446130 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.446115    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"
Jul 15 19:55:34.474123 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.474087    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8489687fcb-dch2g"]
Jul 15 19:55:34.474689 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.474669    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k98t4\" (UniqueName: \"kubernetes.io/projected/90357708-bc2c-41b6-bbe1-13c770dbe384-kube-api-access-k98t4\") pod \"insights-operator-68d9dd94cf-7fkxh\" (UID: \"90357708-bc2c-41b6-bbe1-13c770dbe384\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.476722 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.476705    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.481458 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.481438    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 19:55:34.484103 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.484043    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 19:55:34.486337 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.486319    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 19:55:34.493972 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.493929    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 19:55:34.496516 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.496469    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pndwd\""
Jul 15 19:55:34.526820 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.526788    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8489687fcb-dch2g"]
Jul 15 19:55:34.540545 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.540520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.540692 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.540562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-image-registry-private-configuration\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.540692 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.540589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-installation-pull-secrets\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.540692 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.540636    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-ca-trust-extracted\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.540692 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.540661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2phc\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-kube-api-access-r2phc\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.540891 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.540695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-certificates\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.540891 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.540717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-trusted-ca\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.540891 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.540741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-bound-sa-token\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.567575 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.567550    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh"
Jul 15 19:55:34.639408 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:55:34.639384    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e7ceaa_b5db_497a_810e_2a3b0d7b3dc2.slice/crio-fbcb879ebfc5445e5dba68d8e04280141f0d1d53c6b6c4a8b6dd443ef6f6b1e9 WatchSource:0}: Error finding container fbcb879ebfc5445e5dba68d8e04280141f0d1d53c6b6c4a8b6dd443ef6f6b1e9: Status 404 returned error can't find the container with id fbcb879ebfc5445e5dba68d8e04280141f0d1d53c6b6c4a8b6dd443ef6f6b1e9
Jul 15 19:55:34.641558 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.641538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.641658 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.641578    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-image-registry-private-configuration\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.641658 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.641605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-installation-pull-secrets\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.641658 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.641648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-ca-trust-extracted\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.641880 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.641674    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2phc\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-kube-api-access-r2phc\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.641880 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:34.641702    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:55:34.641880 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.641711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-certificates\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.641880 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:34.641721    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8489687fcb-dch2g: secret "image-registry-tls" not found
Jul 15 19:55:34.641880 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.641736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-trusted-ca\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.641880 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:34.641770    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls podName:0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:35.141750197 +0000 UTC m=+72.778867481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls") pod "image-registry-8489687fcb-dch2g" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8") : secret "image-registry-tls" not found
Jul 15 19:55:34.641880 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.641790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-bound-sa-token\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.642346 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.642328    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-ca-trust-extracted\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.642711 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.642693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-trusted-ca\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.643428 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.643404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-certificates\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.644508 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.644430    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5"]
Jul 15 19:55:34.645570 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.645526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-image-registry-private-configuration\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.645861 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.645843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-installation-pull-secrets\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.689969 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.689925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-bound-sa-token\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.691782 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.691759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2phc\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-kube-api-access-r2phc\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:34.723041 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.723013    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7fkxh"]
Jul 15 19:55:34.726493 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:55:34.726465    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90357708_bc2c_41b6_bbe1_13c770dbe384.slice/crio-b5f43ddc539072e721236b1520d9343598ae0f74f3a3e8ad955adc2d746af46a WatchSource:0}: Error finding container b5f43ddc539072e721236b1520d9343598ae0f74f3a3e8ad955adc2d746af46a: Status 404 returned error can't find the container with id b5f43ddc539072e721236b1520d9343598ae0f74f3a3e8ad955adc2d746af46a
Jul 15 19:55:34.844184 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:34.844146    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xz9cz\" (UID: \"7beb2059-52a2-4a73-8a30-500f99e04d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:34.844380 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:34.844325    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 19:55:34.844446 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:34.844416    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls podName:7beb2059-52a2-4a73-8a30-500f99e04d89 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:35.844394258 +0000 UTC m=+73.481511545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls") pod "cluster-samples-operator-65db858894-xz9cz" (UID: "7beb2059-52a2-4a73-8a30-500f99e04d89") : secret "samples-operator-tls" not found
Jul 15 19:55:35.146018 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:35.145984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:35.146413 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:35.146142    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:55:35.146413 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:35.146161    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8489687fcb-dch2g: secret "image-registry-tls" not found
Jul 15 19:55:35.146413 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:35.146215    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls podName:0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:36.146199435 +0000 UTC m=+73.783316706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls") pod "image-registry-8489687fcb-dch2g" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8") : secret "image-registry-tls" not found
Jul 15 19:55:35.220441 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:35.220405    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5" event={"ID":"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2","Type":"ContainerStarted","Data":"fbcb879ebfc5445e5dba68d8e04280141f0d1d53c6b6c4a8b6dd443ef6f6b1e9"}
Jul 15 19:55:35.221397 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:35.221371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh" event={"ID":"90357708-bc2c-41b6-bbe1-13c770dbe384","Type":"ContainerStarted","Data":"b5f43ddc539072e721236b1520d9343598ae0f74f3a3e8ad955adc2d746af46a"}
Jul 15 19:55:35.852080 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:35.852039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xz9cz\" (UID: \"7beb2059-52a2-4a73-8a30-500f99e04d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:35.852274 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:35.852216    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 19:55:35.852326 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:35.852285    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls podName:7beb2059-52a2-4a73-8a30-500f99e04d89 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:37.85226949 +0000 UTC m=+75.489386761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls") pod "cluster-samples-operator-65db858894-xz9cz" (UID: "7beb2059-52a2-4a73-8a30-500f99e04d89") : secret "samples-operator-tls" not found
Jul 15 19:55:36.155041 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:36.154953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:36.155407 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:36.155100    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:55:36.155407 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:36.155121    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8489687fcb-dch2g: secret "image-registry-tls" not found
Jul 15 19:55:36.155407 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:36.155180    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls podName:0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:38.155163104 +0000 UTC m=+75.792280372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls") pod "image-registry-8489687fcb-dch2g" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8") : secret "image-registry-tls" not found
Jul 15 19:55:37.227985 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:37.227946    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5" event={"ID":"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2","Type":"ContainerStarted","Data":"7c812868303921aa78136cfbd9d889a8875913ac959635929922b30109250937"}
Jul 15 19:55:37.273976 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:37.273905    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5" podStartSLOduration=1.215628223 podStartE2EDuration="3.273888412s" totalImagesPullingTime="2.058260189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:37.265101345 +0000 UTC m=+74.902218637" watchObservedRunningTime="2026-07-15 19:55:37.273888412 +0000 UTC m=+74.911005701"
Jul 15 19:55:37.871510 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:37.871478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xz9cz\" (UID: \"7beb2059-52a2-4a73-8a30-500f99e04d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:37.871707 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:37.871643    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 19:55:37.871772 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:37.871722    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls podName:7beb2059-52a2-4a73-8a30-500f99e04d89 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:41.871700388 +0000 UTC m=+79.508817679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls") pod "cluster-samples-operator-65db858894-xz9cz" (UID: "7beb2059-52a2-4a73-8a30-500f99e04d89") : secret "samples-operator-tls" not found
Jul 15 19:55:38.173287 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:38.173242    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:38.173432 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:38.173401    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:55:38.173432 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:38.173423    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8489687fcb-dch2g: secret "image-registry-tls" not found
Jul 15 19:55:38.173524 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:38.173479    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls podName:0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:42.173465456 +0000 UTC m=+79.810582756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls") pod "image-registry-8489687fcb-dch2g" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8") : secret "image-registry-tls" not found
Jul 15 19:55:38.233967 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:38.233916    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh" event={"ID":"90357708-bc2c-41b6-bbe1-13c770dbe384","Type":"ContainerStarted","Data":"ae2635d8948b34f2d597d6e967ba647364f4c9e1f197cafe0bc5afa4dcf5bafe"}
Jul 15 19:55:38.273968 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:38.273895    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh" podStartSLOduration=1.227236129 podStartE2EDuration="4.273875099s" totalImagesPullingTime="3.04663897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:38.273666154 +0000 UTC m=+75.910783447" watchObservedRunningTime="2026-07-15 19:55:38.273875099 +0000 UTC m=+75.910992390"
Jul 15 19:55:39.860179 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:39.860145    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"]
Jul 15 19:55:39.862031 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:39.862013    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:39.866855 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:39.866666    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 15 19:55:39.866855 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:39.866727    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 15 19:55:39.866855 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:39.866808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mjvxj\""
Jul 15 19:55:39.883169 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:39.883145    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"]
Jul 15 19:55:39.985568 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:39.985530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/290bfa79-50ce-45bd-a448-cda6fc5b54c3-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wqhn4\" (UID: \"290bfa79-50ce-45bd-a448-cda6fc5b54c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:39.985779 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:39.985598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wqhn4\" (UID: \"290bfa79-50ce-45bd-a448-cda6fc5b54c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:40.086435 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.086387    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wqhn4\" (UID: \"290bfa79-50ce-45bd-a448-cda6fc5b54c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:40.086619 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.086469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/290bfa79-50ce-45bd-a448-cda6fc5b54c3-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wqhn4\" (UID: \"290bfa79-50ce-45bd-a448-cda6fc5b54c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:40.086619 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:40.086547    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 19:55:40.086619 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:40.086616    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert podName:290bfa79-50ce-45bd-a448-cda6fc5b54c3 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:40.586599023 +0000 UTC m=+78.223716291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wqhn4" (UID: "290bfa79-50ce-45bd-a448-cda6fc5b54c3") : secret "networking-console-plugin-cert" not found
Jul 15 19:55:40.087047 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.087031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/290bfa79-50ce-45bd-a448-cda6fc5b54c3-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wqhn4\" (UID: \"290bfa79-50ce-45bd-a448-cda6fc5b54c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:40.450828 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.450800    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jx28v"]
Jul 15 19:55:40.452846 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.452830    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.463349 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.463330    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 19:55:40.463455 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.463330    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 19:55:40.464705 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.464684    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cfjnb\""
Jul 15 19:55:40.481914 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.481889    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jx28v"]
Jul 15 19:55:40.489093 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.489069    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5aa9d73d-07f4-4628-85bf-2ab430f58115-data-volume\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.489231 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.489115    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.489231 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.489154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.489344 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.489255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5aa9d73d-07f4-4628-85bf-2ab430f58115-crio-socket\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.489344 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.489317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7267\" (UniqueName: \"kubernetes.io/projected/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-api-access-q7267\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.590236 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.590194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5aa9d73d-07f4-4628-85bf-2ab430f58115-data-volume\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.590401 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.590269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.590401 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.590303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wqhn4\" (UID: \"290bfa79-50ce-45bd-a448-cda6fc5b54c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:40.590401 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.590342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.590626 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:40.590397    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 19:55:40.590626 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.590407    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5aa9d73d-07f4-4628-85bf-2ab430f58115-crio-socket\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.590626 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:40.590427    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 19:55:40.590626 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.590450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7267\" (UniqueName: \"kubernetes.io/projected/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-api-access-q7267\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.590626 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:40.590476    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm podName:5aa9d73d-07f4-4628-85bf-2ab430f58115 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:41.090455065 +0000 UTC m=+78.727572352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jx28v" (UID: "5aa9d73d-07f4-4628-85bf-2ab430f58115") : configmap "kube-rbac-proxy" not found
Jul 15 19:55:40.590626 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.590503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5aa9d73d-07f4-4628-85bf-2ab430f58115-crio-socket\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.590626 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:40.590531    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert podName:290bfa79-50ce-45bd-a448-cda6fc5b54c3 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:41.590498531 +0000 UTC m=+79.227615817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wqhn4" (UID: "290bfa79-50ce-45bd-a448-cda6fc5b54c3") : secret "networking-console-plugin-cert" not found
Jul 15 19:55:40.590626 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.590555    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5aa9d73d-07f4-4628-85bf-2ab430f58115-data-volume\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:40.590626 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:40.590588    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 19:55:40.590914 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:40.590644    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls podName:5aa9d73d-07f4-4628-85bf-2ab430f58115 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:41.090631478 +0000 UTC m=+78.727748760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jx28v" (UID: "5aa9d73d-07f4-4628-85bf-2ab430f58115") : secret "insights-runtime-extractor-tls" not found
Jul 15 19:55:40.628064 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:40.628020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7267\" (UniqueName: \"kubernetes.io/projected/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-api-access-q7267\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:41.094106 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:41.094079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:41.094484 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:41.094132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:41.094484 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:41.094196    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 19:55:41.094484 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:41.094236    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 19:55:41.094484 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:41.094278    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm podName:5aa9d73d-07f4-4628-85bf-2ab430f58115 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:42.094258277 +0000 UTC m=+79.731375545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jx28v" (UID: "5aa9d73d-07f4-4628-85bf-2ab430f58115") : configmap "kube-rbac-proxy" not found
Jul 15 19:55:41.094484 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:41.094292    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls podName:5aa9d73d-07f4-4628-85bf-2ab430f58115 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:42.094285443 +0000 UTC m=+79.731402711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jx28v" (UID: "5aa9d73d-07f4-4628-85bf-2ab430f58115") : secret "insights-runtime-extractor-tls" not found
Jul 15 19:55:41.599430 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:41.599390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wqhn4\" (UID: \"290bfa79-50ce-45bd-a448-cda6fc5b54c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:41.599608 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:41.599533    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 19:55:41.599608 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:41.599598    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert podName:290bfa79-50ce-45bd-a448-cda6fc5b54c3 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:43.599580994 +0000 UTC m=+81.236698268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wqhn4" (UID: "290bfa79-50ce-45bd-a448-cda6fc5b54c3") : secret "networking-console-plugin-cert" not found
Jul 15 19:55:41.901804 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:41.901719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xz9cz\" (UID: \"7beb2059-52a2-4a73-8a30-500f99e04d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:41.901982 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:41.901882    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 19:55:41.901982 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:41.901970    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls podName:7beb2059-52a2-4a73-8a30-500f99e04d89 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:49.901928505 +0000 UTC m=+87.539045775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls") pod "cluster-samples-operator-65db858894-xz9cz" (UID: "7beb2059-52a2-4a73-8a30-500f99e04d89") : secret "samples-operator-tls" not found
Jul 15 19:55:42.103102 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:42.103058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:42.103543 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:42.103148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:42.103543 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:42.103176    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 19:55:42.103543 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:42.103255    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm podName:5aa9d73d-07f4-4628-85bf-2ab430f58115 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:44.103239748 +0000 UTC m=+81.740357016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jx28v" (UID: "5aa9d73d-07f4-4628-85bf-2ab430f58115") : configmap "kube-rbac-proxy" not found
Jul 15 19:55:42.103543 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:42.103287    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 19:55:42.103543 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:42.103350    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls podName:5aa9d73d-07f4-4628-85bf-2ab430f58115 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:44.103333471 +0000 UTC m=+81.740450741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jx28v" (UID: "5aa9d73d-07f4-4628-85bf-2ab430f58115") : secret "insights-runtime-extractor-tls" not found
Jul 15 19:55:42.203708 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:42.203613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:42.203862 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:42.203760    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:55:42.203862 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:42.203780    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8489687fcb-dch2g: secret "image-registry-tls" not found
Jul 15 19:55:42.203862 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:42.203830    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls podName:0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:50.203816495 +0000 UTC m=+87.840933767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls") pod "image-registry-8489687fcb-dch2g" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8") : secret "image-registry-tls" not found
Jul 15 19:55:43.235312 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:43.235282    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6sf8b_c2d28289-371c-4a8f-90d9-445c4717085d/dns-node-resolver/0.log"
Jul 15 19:55:43.616462 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:43.616415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wqhn4\" (UID: \"290bfa79-50ce-45bd-a448-cda6fc5b54c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:43.616632 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:43.616587    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 19:55:43.616672 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:43.616659    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert podName:290bfa79-50ce-45bd-a448-cda6fc5b54c3 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:47.616643061 +0000 UTC m=+85.253760329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wqhn4" (UID: "290bfa79-50ce-45bd-a448-cda6fc5b54c3") : secret "networking-console-plugin-cert" not found
Jul 15 19:55:44.120513 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:44.120474    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:44.120713 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:44.120529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:44.120713 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:44.120620    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 19:55:44.120713 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:44.120622    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 19:55:44.120713 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:44.120675    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm podName:5aa9d73d-07f4-4628-85bf-2ab430f58115 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:48.120660016 +0000 UTC m=+85.757777284 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jx28v" (UID: "5aa9d73d-07f4-4628-85bf-2ab430f58115") : configmap "kube-rbac-proxy" not found
Jul 15 19:55:44.120713 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:44.120689    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls podName:5aa9d73d-07f4-4628-85bf-2ab430f58115 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:48.120682947 +0000 UTC m=+85.757800214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jx28v" (UID: "5aa9d73d-07f4-4628-85bf-2ab430f58115") : secret "insights-runtime-extractor-tls" not found
Jul 15 19:55:44.235851 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:44.235826    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9gbzl_70e0d3b8-298c-4cee-be41-9e559fbd3711/node-ca/0.log"
Jul 15 19:55:45.233954 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:45.233906    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v8qbh_36995e4c-2a4b-4381-8c3d-0f515a4112af/serve-healthcheck-canary/0.log"
Jul 15 19:55:45.855743 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:45.855715    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-wswf5_12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2/kube-storage-version-migrator-operator/0.log"
Jul 15 19:55:47.652186 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:47.652154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wqhn4\" (UID: \"290bfa79-50ce-45bd-a448-cda6fc5b54c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:47.652563 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:47.652313    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 19:55:47.652563 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:47.652377    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert podName:290bfa79-50ce-45bd-a448-cda6fc5b54c3 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:55.652362053 +0000 UTC m=+93.289479324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wqhn4" (UID: "290bfa79-50ce-45bd-a448-cda6fc5b54c3") : secret "networking-console-plugin-cert" not found
Jul 15 19:55:48.156103 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:48.156067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:48.156271 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:48.156119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:48.156271 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:48.156195    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 19:55:48.156271 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:48.156230    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 19:55:48.156271 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:48.156257    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm podName:5aa9d73d-07f4-4628-85bf-2ab430f58115 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:56.15624333 +0000 UTC m=+93.793360601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jx28v" (UID: "5aa9d73d-07f4-4628-85bf-2ab430f58115") : configmap "kube-rbac-proxy" not found
Jul 15 19:55:48.156271 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:55:48.156273    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls podName:5aa9d73d-07f4-4628-85bf-2ab430f58115 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:56.156263077 +0000 UTC m=+93.793380345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jx28v" (UID: "5aa9d73d-07f4-4628-85bf-2ab430f58115") : secret "insights-runtime-extractor-tls" not found
Jul 15 19:55:49.971482 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:49.971435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xz9cz\" (UID: \"7beb2059-52a2-4a73-8a30-500f99e04d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:49.974033 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:49.974011    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7beb2059-52a2-4a73-8a30-500f99e04d89-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xz9cz\" (UID: \"7beb2059-52a2-4a73-8a30-500f99e04d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:50.054864 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:50.054823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"
Jul 15 19:55:50.185927 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:50.185897    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz"]
Jul 15 19:55:50.268777 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:50.268744    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz" event={"ID":"7beb2059-52a2-4a73-8a30-500f99e04d89","Type":"ContainerStarted","Data":"f3717d8aaf7713e96b49d74c2e1b353eea7177ee84ea96fdd1dec84a8fecaade"}
Jul 15 19:55:50.275179 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:50.275157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:50.277430 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:50.277412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls\") pod \"image-registry-8489687fcb-dch2g\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") " pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:50.387082 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:50.387039    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:50.542840 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:50.542774    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8489687fcb-dch2g"]
Jul 15 19:55:50.545770 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:55:50.545738    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea7e4b6_c8b1_4bb8_86b7_f54dcaf16ee8.slice/crio-94e34c5a38c70af7657a58d3ae352bca6603cc51408aa3140c04e8af5494638e WatchSource:0}: Error finding container 94e34c5a38c70af7657a58d3ae352bca6603cc51408aa3140c04e8af5494638e: Status 404 returned error can't find the container with id 94e34c5a38c70af7657a58d3ae352bca6603cc51408aa3140c04e8af5494638e
Jul 15 19:55:51.274574 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:51.274540    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8489687fcb-dch2g" event={"ID":"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8","Type":"ContainerStarted","Data":"513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2"}
Jul 15 19:55:51.275014 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:51.274588    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8489687fcb-dch2g" event={"ID":"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8","Type":"ContainerStarted","Data":"94e34c5a38c70af7657a58d3ae352bca6603cc51408aa3140c04e8af5494638e"}
Jul 15 19:55:51.275014 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:51.274677    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:55:51.299748 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:51.299695    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8489687fcb-dch2g" podStartSLOduration=17.299680328 podStartE2EDuration="17.299680328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:55:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:51.299463031 +0000 UTC m=+88.936580322" watchObservedRunningTime="2026-07-15 19:55:51.299680328 +0000 UTC m=+88.936797618"
Jul 15 19:55:52.279334 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:52.279199    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz" event={"ID":"7beb2059-52a2-4a73-8a30-500f99e04d89","Type":"ContainerStarted","Data":"b42c24bce612208e87b95edb59c3ac1839fb06d0408ab373776dfa255cee646c"}
Jul 15 19:55:52.279334 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:52.279256    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz" event={"ID":"7beb2059-52a2-4a73-8a30-500f99e04d89","Type":"ContainerStarted","Data":"359a63acd5f893361872dc46091defb15d7b7d65a72e8991a13b2d916de332ba"}
Jul 15 19:55:52.302928 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:52.302882    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xz9cz" podStartSLOduration=16.602250564 podStartE2EDuration="18.302865908s" totalImagesPullingTime="1.700615344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:52.302602961 +0000 UTC m=+89.939720251" watchObservedRunningTime="2026-07-15 19:55:52.302865908 +0000 UTC m=+89.939983197"
Jul 15 19:55:55.717571 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:55.717526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wqhn4\" (UID: \"290bfa79-50ce-45bd-a448-cda6fc5b54c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:55.719978 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:55.719957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/290bfa79-50ce-45bd-a448-cda6fc5b54c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wqhn4\" (UID: \"290bfa79-50ce-45bd-a448-cda6fc5b54c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:55.770517 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:55.770492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"
Jul 15 19:55:55.898599 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:55.898579    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wqhn4"]
Jul 15 19:55:55.901190 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:55:55.901167    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290bfa79_50ce_45bd_a448_cda6fc5b54c3.slice/crio-5e8cba8158ffe72f619fe4220fbd2953da5ab92160333dd0925382dcef1dd16e WatchSource:0}: Error finding container 5e8cba8158ffe72f619fe4220fbd2953da5ab92160333dd0925382dcef1dd16e: Status 404 returned error can't find the container with id 5e8cba8158ffe72f619fe4220fbd2953da5ab92160333dd0925382dcef1dd16e
Jul 15 19:55:56.222848 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:56.222814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:56.223058 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:56.222878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:56.223394 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:56.223370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5aa9d73d-07f4-4628-85bf-2ab430f58115-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:56.225334 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:56.225315    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5aa9d73d-07f4-4628-85bf-2ab430f58115-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jx28v\" (UID: \"5aa9d73d-07f4-4628-85bf-2ab430f58115\") " pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:56.294195 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:56.294166    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4" event={"ID":"290bfa79-50ce-45bd-a448-cda6fc5b54c3","Type":"ContainerStarted","Data":"5e8cba8158ffe72f619fe4220fbd2953da5ab92160333dd0925382dcef1dd16e"}
Jul 15 19:55:56.361571 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:56.361546    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jx28v"
Jul 15 19:55:56.500082 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:56.500003    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jx28v"]
Jul 15 19:55:56.503163 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:55:56.503142    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa9d73d_07f4_4628_85bf_2ab430f58115.slice/crio-18cd63403b6f7360f0b8fd5a07b0156a6a7272de227388a92b02dde3f7b9bc54 WatchSource:0}: Error finding container 18cd63403b6f7360f0b8fd5a07b0156a6a7272de227388a92b02dde3f7b9bc54: Status 404 returned error can't find the container with id 18cd63403b6f7360f0b8fd5a07b0156a6a7272de227388a92b02dde3f7b9bc54
Jul 15 19:55:57.300257 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:57.300157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jx28v" event={"ID":"5aa9d73d-07f4-4628-85bf-2ab430f58115","Type":"ContainerStarted","Data":"18cd63403b6f7360f0b8fd5a07b0156a6a7272de227388a92b02dde3f7b9bc54"}
Jul 15 19:55:58.305297 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:58.305259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4" event={"ID":"290bfa79-50ce-45bd-a448-cda6fc5b54c3","Type":"ContainerStarted","Data":"8490cc962d3d756c4dec2353791352ae1f4db5abb399f11b9657c84a88ca99d2"}
Jul 15 19:55:58.338738 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:55:58.338688    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-wqhn4" podStartSLOduration=17.543164895 podStartE2EDuration="19.338637188s" totalImagesPullingTime="1.795472293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:58.338091236 +0000 UTC m=+95.975208528" watchObservedRunningTime="2026-07-15 19:55:58.338637188 +0000 UTC m=+95.975754478"
Jul 15 19:56:01.874858 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:01.874774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:56:01.877128 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:01.877109    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46a85b1-9906-48b0-b399-ece5b1699802-metrics-tls\") pod \"dns-default-m8n8f\" (UID: \"f46a85b1-9906-48b0-b399-ece5b1699802\") " pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:56:02.112212 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:02.112187    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c5qnq\""
Jul 15 19:56:02.119138 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:02.119122    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:56:02.265796 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:02.265767    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m8n8f"]
Jul 15 19:56:02.269369 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:56:02.269340    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46a85b1_9906_48b0_b399_ece5b1699802.slice/crio-21f704da78ddfe65ddf7dca689ee3c6d793a72b3989bae8293eee9a7c3cfa9bc WatchSource:0}: Error finding container 21f704da78ddfe65ddf7dca689ee3c6d793a72b3989bae8293eee9a7c3cfa9bc: Status 404 returned error can't find the container with id 21f704da78ddfe65ddf7dca689ee3c6d793a72b3989bae8293eee9a7c3cfa9bc
Jul 15 19:56:02.322586 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:02.322535    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jx28v" event={"ID":"5aa9d73d-07f4-4628-85bf-2ab430f58115","Type":"ContainerStarted","Data":"a99fabe4ad35b07cbb9176f8e8035a14ed921c89c673c93bbe0389384fd56d3b"}
Jul 15 19:56:02.324057 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:02.324030    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8n8f" event={"ID":"f46a85b1-9906-48b0-b399-ece5b1699802","Type":"ContainerStarted","Data":"21f704da78ddfe65ddf7dca689ee3c6d793a72b3989bae8293eee9a7c3cfa9bc"}
Jul 15 19:56:04.371182 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.371151    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq"]
Jul 15 19:56:04.387686 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.387656    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8489687fcb-dch2g"]
Jul 15 19:56:04.387844 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.387793    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq"
Jul 15 19:56:04.415421 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.415398    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 19:56:04.416414 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.416391    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 19:56:04.416553 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.416463    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 19:56:04.417006 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.416988    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 19:56:04.423437 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.423411    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"]
Jul 15 19:56:04.428569 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.428550    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq"]
Jul 15 19:56:04.428668 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.428624    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:04.439791 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.439770    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-lwznt\""
Jul 15 19:56:04.440990 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.440976    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 19:56:04.497469 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.497433    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb535104-7fef-423e-ae55-190b9dd8118c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85b74c7cf4-989cq\" (UID: \"eb535104-7fef-423e-ae55-190b9dd8118c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq"
Jul 15 19:56:04.497625 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.497494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rdn2\" (UniqueName: \"kubernetes.io/projected/eb535104-7fef-423e-ae55-190b9dd8118c-kube-api-access-5rdn2\") pod \"managed-serviceaccount-addon-agent-85b74c7cf4-989cq\" (UID: \"eb535104-7fef-423e-ae55-190b9dd8118c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq"
Jul 15 19:56:04.529083 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.529052    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"]
Jul 15 19:56:04.597817 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.597790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6c71fc86-ec12-424c-a0de-b30842149587-klusterlet-config\") pod \"klusterlet-addon-workmgr-f5bf686cb-4vsdn\" (UID: \"6c71fc86-ec12-424c-a0de-b30842149587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:04.597996 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.597834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb535104-7fef-423e-ae55-190b9dd8118c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85b74c7cf4-989cq\" (UID: \"eb535104-7fef-423e-ae55-190b9dd8118c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq"
Jul 15 19:56:04.597996 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.597863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c71fc86-ec12-424c-a0de-b30842149587-tmp\") pod \"klusterlet-addon-workmgr-f5bf686cb-4vsdn\" (UID: \"6c71fc86-ec12-424c-a0de-b30842149587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:04.597996 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.597889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rdn2\" (UniqueName: \"kubernetes.io/projected/eb535104-7fef-423e-ae55-190b9dd8118c-kube-api-access-5rdn2\") pod \"managed-serviceaccount-addon-agent-85b74c7cf4-989cq\" (UID: \"eb535104-7fef-423e-ae55-190b9dd8118c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq"
Jul 15 19:56:04.597996 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.597924    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg2vp\" (UniqueName: \"kubernetes.io/projected/6c71fc86-ec12-424c-a0de-b30842149587-kube-api-access-rg2vp\") pod \"klusterlet-addon-workmgr-f5bf686cb-4vsdn\" (UID: \"6c71fc86-ec12-424c-a0de-b30842149587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:04.600606 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.600574    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb535104-7fef-423e-ae55-190b9dd8118c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85b74c7cf4-989cq\" (UID: \"eb535104-7fef-423e-ae55-190b9dd8118c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq"
Jul 15 19:56:04.698771 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.698691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c71fc86-ec12-424c-a0de-b30842149587-tmp\") pod \"klusterlet-addon-workmgr-f5bf686cb-4vsdn\" (UID: \"6c71fc86-ec12-424c-a0de-b30842149587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:04.698771 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.698747    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg2vp\" (UniqueName: \"kubernetes.io/projected/6c71fc86-ec12-424c-a0de-b30842149587-kube-api-access-rg2vp\") pod \"klusterlet-addon-workmgr-f5bf686cb-4vsdn\" (UID: \"6c71fc86-ec12-424c-a0de-b30842149587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:04.698988 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.698805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6c71fc86-ec12-424c-a0de-b30842149587-klusterlet-config\") pod \"klusterlet-addon-workmgr-f5bf686cb-4vsdn\" (UID: \"6c71fc86-ec12-424c-a0de-b30842149587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:04.699178 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.699150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c71fc86-ec12-424c-a0de-b30842149587-tmp\") pod \"klusterlet-addon-workmgr-f5bf686cb-4vsdn\" (UID: \"6c71fc86-ec12-424c-a0de-b30842149587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:04.701589 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.701565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6c71fc86-ec12-424c-a0de-b30842149587-klusterlet-config\") pod \"klusterlet-addon-workmgr-f5bf686cb-4vsdn\" (UID: \"6c71fc86-ec12-424c-a0de-b30842149587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:04.704680 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.704657    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54c76b8d-h28sd"]
Jul 15 19:56:04.730135 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.729167    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:04.733271 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.733250    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rdn2\" (UniqueName: \"kubernetes.io/projected/eb535104-7fef-423e-ae55-190b9dd8118c-kube-api-access-5rdn2\") pod \"managed-serviceaccount-addon-agent-85b74c7cf4-989cq\" (UID: \"eb535104-7fef-423e-ae55-190b9dd8118c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq"
Jul 15 19:56:04.744106 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.743863    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54c76b8d-h28sd"]
Jul 15 19:56:04.771285 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.771261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg2vp\" (UniqueName: \"kubernetes.io/projected/6c71fc86-ec12-424c-a0de-b30842149587-kube-api-access-rg2vp\") pod \"klusterlet-addon-workmgr-f5bf686cb-4vsdn\" (UID: \"6c71fc86-ec12-424c-a0de-b30842149587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:04.899763 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.899733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50c69461-419b-4f01-8b0d-8c067d7a4e5a-ca-trust-extracted\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:04.899919 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.899779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50c69461-419b-4f01-8b0d-8c067d7a4e5a-registry-certificates\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:04.899919 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.899857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50c69461-419b-4f01-8b0d-8c067d7a4e5a-registry-tls\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:04.899919 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.899896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50c69461-419b-4f01-8b0d-8c067d7a4e5a-trusted-ca\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:04.900083 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.899954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50c69461-419b-4f01-8b0d-8c067d7a4e5a-image-registry-private-configuration\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:04.900083 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.900003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50c69461-419b-4f01-8b0d-8c067d7a4e5a-installation-pull-secrets\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:04.900185 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.900089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-744cz\" (UniqueName: \"kubernetes.io/projected/50c69461-419b-4f01-8b0d-8c067d7a4e5a-kube-api-access-744cz\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:04.900185 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:04.900146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50c69461-419b-4f01-8b0d-8c067d7a4e5a-bound-sa-token\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.000735 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.000647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50c69461-419b-4f01-8b0d-8c067d7a4e5a-image-registry-private-configuration\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.000735 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.000702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50c69461-419b-4f01-8b0d-8c067d7a4e5a-installation-pull-secrets\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.001011 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.000749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-744cz\" (UniqueName: \"kubernetes.io/projected/50c69461-419b-4f01-8b0d-8c067d7a4e5a-kube-api-access-744cz\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.001011 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.000781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50c69461-419b-4f01-8b0d-8c067d7a4e5a-bound-sa-token\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.001011 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.000822    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50c69461-419b-4f01-8b0d-8c067d7a4e5a-ca-trust-extracted\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.001011 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.000880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50c69461-419b-4f01-8b0d-8c067d7a4e5a-registry-certificates\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.001011 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.000908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50c69461-419b-4f01-8b0d-8c067d7a4e5a-registry-tls\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.001011 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.000953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50c69461-419b-4f01-8b0d-8c067d7a4e5a-trusted-ca\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.001424 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.001399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50c69461-419b-4f01-8b0d-8c067d7a4e5a-ca-trust-extracted\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.001769 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.001743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50c69461-419b-4f01-8b0d-8c067d7a4e5a-registry-certificates\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.001990 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.001949    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50c69461-419b-4f01-8b0d-8c067d7a4e5a-trusted-ca\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.003812 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.003787    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50c69461-419b-4f01-8b0d-8c067d7a4e5a-image-registry-private-configuration\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.004088 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.004056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50c69461-419b-4f01-8b0d-8c067d7a4e5a-installation-pull-secrets\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.004088 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.004078    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50c69461-419b-4f01-8b0d-8c067d7a4e5a-registry-tls\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.007980 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.007961    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq"
Jul 15 19:56:05.038242 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.038218    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:05.068648 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.068621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-744cz\" (UniqueName: \"kubernetes.io/projected/50c69461-419b-4f01-8b0d-8c067d7a4e5a-kube-api-access-744cz\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.071572 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.071547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50c69461-419b-4f01-8b0d-8c067d7a4e5a-bound-sa-token\") pod \"image-registry-54c76b8d-h28sd\" (UID: \"50c69461-419b-4f01-8b0d-8c067d7a4e5a\") " pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:05.224537 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.224508    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k8sd5"
Jul 15 19:56:05.347341 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:05.347316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:06.226174 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:06.226143    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"]
Jul 15 19:56:06.241392 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:06.241367    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq"]
Jul 15 19:56:06.288205 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:56:06.288171    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c71fc86_ec12_424c_a0de_b30842149587.slice/crio-ed61b6fc87a5f571faf74d90b8273898bd890bcd96bd85da2b0919b3351024f8 WatchSource:0}: Error finding container ed61b6fc87a5f571faf74d90b8273898bd890bcd96bd85da2b0919b3351024f8: Status 404 returned error can't find the container with id ed61b6fc87a5f571faf74d90b8273898bd890bcd96bd85da2b0919b3351024f8
Jul 15 19:56:06.289649 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:56:06.289612    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb535104_7fef_423e_ae55_190b9dd8118c.slice/crio-3bc9d8d026fc7dfbabf114c9a138b7158de3f4c778bffe187f425237824f1054 WatchSource:0}: Error finding container 3bc9d8d026fc7dfbabf114c9a138b7158de3f4c778bffe187f425237824f1054: Status 404 returned error can't find the container with id 3bc9d8d026fc7dfbabf114c9a138b7158de3f4c778bffe187f425237824f1054
Jul 15 19:56:06.291039 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:06.290992    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54c76b8d-h28sd"]
Jul 15 19:56:06.293399 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:56:06.293362    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c69461_419b_4f01_8b0d_8c067d7a4e5a.slice/crio-5bdc293c590cb5d523b2e3d7067f17940f1930b44e2882180064a4b5b94aec92 WatchSource:0}: Error finding container 5bdc293c590cb5d523b2e3d7067f17940f1930b44e2882180064a4b5b94aec92: Status 404 returned error can't find the container with id 5bdc293c590cb5d523b2e3d7067f17940f1930b44e2882180064a4b5b94aec92
Jul 15 19:56:06.339604 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:06.339530    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8n8f" event={"ID":"f46a85b1-9906-48b0-b399-ece5b1699802","Type":"ContainerStarted","Data":"aa4d33750c1db8d62022149f80be73c4268937593165acf7d35740257a958ad6"}
Jul 15 19:56:06.341761 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:06.341735    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq" event={"ID":"eb535104-7fef-423e-ae55-190b9dd8118c","Type":"ContainerStarted","Data":"3bc9d8d026fc7dfbabf114c9a138b7158de3f4c778bffe187f425237824f1054"}
Jul 15 19:56:06.343168 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:06.343109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54c76b8d-h28sd" event={"ID":"50c69461-419b-4f01-8b0d-8c067d7a4e5a","Type":"ContainerStarted","Data":"5bdc293c590cb5d523b2e3d7067f17940f1930b44e2882180064a4b5b94aec92"}
Jul 15 19:56:06.344319 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:06.344271    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn" event={"ID":"6c71fc86-ec12-424c-a0de-b30842149587","Type":"ContainerStarted","Data":"ed61b6fc87a5f571faf74d90b8273898bd890bcd96bd85da2b0919b3351024f8"}
Jul 15 19:56:07.353065 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:07.352890    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jx28v" event={"ID":"5aa9d73d-07f4-4628-85bf-2ab430f58115","Type":"ContainerStarted","Data":"3349239d78e23a371aa5fb89069b37d130fa7e018041f3cd7b8b83c6bb549381"}
Jul 15 19:56:07.358095 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:07.357552    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8n8f" event={"ID":"f46a85b1-9906-48b0-b399-ece5b1699802","Type":"ContainerStarted","Data":"bf012d5fee0396342513fb70331c1ef28e821040a22565a57ada6e3355123403"}
Jul 15 19:56:07.358095 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:07.358022    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:56:07.361907 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:07.361338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54c76b8d-h28sd" event={"ID":"50c69461-419b-4f01-8b0d-8c067d7a4e5a","Type":"ContainerStarted","Data":"831c471ea429557826c40d35e6d7e084dee7db3eebef92a665bef8e9122fe956"}
Jul 15 19:56:07.361907 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:07.361863    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:07.388080 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:07.386922    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m8n8f" podStartSLOduration=66.606781818 podStartE2EDuration="1m10.386902899s" totalImagesPullingTime="3.780121081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:07.386370893 +0000 UTC m=+105.023488188" watchObservedRunningTime="2026-07-15 19:56:07.386902899 +0000 UTC m=+105.024020194"
Jul 15 19:56:07.436213 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:07.436158    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54c76b8d-h28sd" podStartSLOduration=3.436137689 podStartE2EDuration="3.436137689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:56:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:07.434972379 +0000 UTC m=+105.072089670" watchObservedRunningTime="2026-07-15 19:56:07.436137689 +0000 UTC m=+105.073254979"
Jul 15 19:56:13.386945 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:13.386906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jx28v" event={"ID":"5aa9d73d-07f4-4628-85bf-2ab430f58115","Type":"ContainerStarted","Data":"0680a24d0dd7f23c2df81726c91262f6a0d23efac6469b995946931a1b0564f3"}
Jul 15 19:56:13.388410 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:13.388383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq" event={"ID":"eb535104-7fef-423e-ae55-190b9dd8118c","Type":"ContainerStarted","Data":"b969f0c14960bf684727137608e775fc841fbcc7f9bdd9209a5c63e4f57d317c"}
Jul 15 19:56:13.389715 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:13.389691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn" event={"ID":"6c71fc86-ec12-424c-a0de-b30842149587","Type":"ContainerStarted","Data":"7a0c1af6562a431eb3dce9e79bab258e79884d9cfc0906d2ef878aa11f957fb6"}
Jul 15 19:56:13.389909 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:13.389894    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:13.391538 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:13.391520    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn"
Jul 15 19:56:13.413605 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:13.413555    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jx28v" podStartSLOduration=17.642120252 podStartE2EDuration="33.413539733s" totalImagesPullingTime="15.771419481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:55:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:13.41205877 +0000 UTC m=+111.049176077" watchObservedRunningTime="2026-07-15 19:56:13.413539733 +0000 UTC m=+111.050657023"
Jul 15 19:56:13.436024 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:13.435980    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85b74c7cf4-989cq" podStartSLOduration=3.315333726 podStartE2EDuration="9.43596653s" totalImagesPullingTime="6.120632804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:13.434383746 +0000 UTC m=+111.071501035" watchObservedRunningTime="2026-07-15 19:56:13.43596653 +0000 UTC m=+111.073083819"
Jul 15 19:56:14.393779 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:14.393754    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:56:14.420366 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:14.420322    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5bf686cb-4vsdn" podStartSLOduration=4.279575176 podStartE2EDuration="10.42030805s" totalImagesPullingTime="6.140732874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:13.465387157 +0000 UTC m=+111.102504447" watchObservedRunningTime="2026-07-15 19:56:14.42030805 +0000 UTC m=+112.057425341"
Jul 15 19:56:17.369120 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:17.369091    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m8n8f"
Jul 15 19:56:18.986548 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:18.986510    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7lsdv"]
Jul 15 19:56:18.988815 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:18.988794    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.003895 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.003875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3fc10e4b-325e-418f-b855-460074a93fa9-root\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.004012 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.003919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-wtmp\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.004012 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.003960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fc10e4b-325e-418f-b855-460074a93fa9-metrics-client-ca\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.004119 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.004007    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-textfile\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.004119 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.004035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3fc10e4b-325e-418f-b855-460074a93fa9-sys\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.004119 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.004059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b7pc\" (UniqueName: \"kubernetes.io/projected/3fc10e4b-325e-418f-b855-460074a93fa9-kube-api-access-7b7pc\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.004119 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.004115    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.004240 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.004135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-tls\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.004240 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.004160    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.006985 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.006971    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 19:56:19.013921 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.013905    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 19:56:19.017075 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.017062    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dpkjd\""
Jul 15 19:56:19.017232 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.017218    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 19:56:19.020810 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.020791    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 19:56:19.028505 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.028490    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 19:56:19.067345 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.067323    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 19:56:19.104480 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.104453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b7pc\" (UniqueName: \"kubernetes.io/projected/3fc10e4b-325e-418f-b855-460074a93fa9-kube-api-access-7b7pc\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.104619 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.104501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.104619 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.104532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-tls\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.104619 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.104560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.104619 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.104587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3fc10e4b-325e-418f-b855-460074a93fa9-root\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.104816 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.104754    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-wtmp\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.104816 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.104797    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3fc10e4b-325e-418f-b855-460074a93fa9-root\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.104962 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.104815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fc10e4b-325e-418f-b855-460074a93fa9-metrics-client-ca\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.104962 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.104851    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-textfile\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.104962 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.104880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3fc10e4b-325e-418f-b855-460074a93fa9-sys\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.104962 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.104926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-wtmp\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.105139 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.104976    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3fc10e4b-325e-418f-b855-460074a93fa9-sys\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.105224 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.105202    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.105286 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.105274    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-textfile\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.105428 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.105409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fc10e4b-325e-418f-b855-460074a93fa9-metrics-client-ca\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.107142 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.107124    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.107294 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.107278    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3fc10e4b-325e-418f-b855-460074a93fa9-node-exporter-tls\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.259443 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.259374    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b7pc\" (UniqueName: \"kubernetes.io/projected/3fc10e4b-325e-418f-b855-460074a93fa9-kube-api-access-7b7pc\") pod \"node-exporter-7lsdv\" (UID: \"3fc10e4b-325e-418f-b855-460074a93fa9\") " pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.296964 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.296914    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7lsdv"
Jul 15 19:56:19.307363 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:56:19.307342    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc10e4b_325e_418f_b855_460074a93fa9.slice/crio-51f6f1f7cc88b10e2ef29df3a33e5c370356b6926e8780d6a7604bea3625cb9d WatchSource:0}: Error finding container 51f6f1f7cc88b10e2ef29df3a33e5c370356b6926e8780d6a7604bea3625cb9d: Status 404 returned error can't find the container with id 51f6f1f7cc88b10e2ef29df3a33e5c370356b6926e8780d6a7604bea3625cb9d
Jul 15 19:56:19.410439 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:19.410411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lsdv" event={"ID":"3fc10e4b-325e-418f-b855-460074a93fa9","Type":"ContainerStarted","Data":"51f6f1f7cc88b10e2ef29df3a33e5c370356b6926e8780d6a7604bea3625cb9d"}
Jul 15 19:56:20.415193 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:20.415153    2560 generic.go:356] "Generic (PLEG): container finished" podID="3fc10e4b-325e-418f-b855-460074a93fa9" containerID="c56f2b08417034479d9c7eceeb0cf79958e4361d94fe2c027b55b2a30cef8d39" exitCode=0
Jul 15 19:56:20.415540 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:20.415212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lsdv" event={"ID":"3fc10e4b-325e-418f-b855-460074a93fa9","Type":"ContainerDied","Data":"c56f2b08417034479d9c7eceeb0cf79958e4361d94fe2c027b55b2a30cef8d39"}
Jul 15 19:56:21.421340 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:21.421303    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lsdv" event={"ID":"3fc10e4b-325e-418f-b855-460074a93fa9","Type":"ContainerStarted","Data":"0ee0031ccb907e14189f3419a0a4675780e0f4944c29e88822499ff40ffec815"}
Jul 15 19:56:21.421724 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:21.421368    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lsdv" event={"ID":"3fc10e4b-325e-418f-b855-460074a93fa9","Type":"ContainerStarted","Data":"18032f02201335752d69acda29a1441f1bf6a82f258a5fd6b422c52fbe72fe8c"}
Jul 15 19:56:21.453505 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:21.453454    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7lsdv" podStartSLOduration=2.508129013 podStartE2EDuration="3.453438618s" totalImagesPullingTime="874.356675ms" totalInitContainerRuntime="70.95293ms" isStatefulPod=true podCreationTimestamp="2026-07-15 19:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:21.453028948 +0000 UTC m=+119.090146238" watchObservedRunningTime="2026-07-15 19:56:21.453438618 +0000 UTC m=+119.090555920"
Jul 15 19:56:29.089682 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.089649    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-48n48"]
Jul 15 19:56:29.094723 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.094706    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-48n48"
Jul 15 19:56:29.098821 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.098802    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 19:56:29.099031 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.099020    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-679mm\""
Jul 15 19:56:29.101105 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.101090    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 19:56:29.115976 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.115919    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-48n48"]
Jul 15 19:56:29.184770 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.184737    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6whq\" (UniqueName: \"kubernetes.io/projected/746ed836-caef-44c2-8176-39afca487957-kube-api-access-x6whq\") pod \"downloads-68c9cbb497-48n48\" (UID: \"746ed836-caef-44c2-8176-39afca487957\") " pod="openshift-console/downloads-68c9cbb497-48n48"
Jul 15 19:56:29.285997 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.285916    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6whq\" (UniqueName: \"kubernetes.io/projected/746ed836-caef-44c2-8176-39afca487957-kube-api-access-x6whq\") pod \"downloads-68c9cbb497-48n48\" (UID: \"746ed836-caef-44c2-8176-39afca487957\") " pod="openshift-console/downloads-68c9cbb497-48n48"
Jul 15 19:56:29.300145 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.300117    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6whq\" (UniqueName: \"kubernetes.io/projected/746ed836-caef-44c2-8176-39afca487957-kube-api-access-x6whq\") pod \"downloads-68c9cbb497-48n48\" (UID: \"746ed836-caef-44c2-8176-39afca487957\") " pod="openshift-console/downloads-68c9cbb497-48n48"
Jul 15 19:56:29.375551 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.375527    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54c76b8d-h28sd"
Jul 15 19:56:29.403557 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.403529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-48n48"
Jul 15 19:56:29.418703 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.418656    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8489687fcb-dch2g" podUID="0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" containerName="registry" containerID="cri-o://513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2" gracePeriod=30
Jul 15 19:56:29.559134 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.559105    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-48n48"]
Jul 15 19:56:29.561391 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:56:29.561360    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746ed836_caef_44c2_8176_39afca487957.slice/crio-b519a95386f75fabb3d891e1e00fd2b8e1442fc743701db889d21a749b49546d WatchSource:0}: Error finding container b519a95386f75fabb3d891e1e00fd2b8e1442fc743701db889d21a749b49546d: Status 404 returned error can't find the container with id b519a95386f75fabb3d891e1e00fd2b8e1442fc743701db889d21a749b49546d
Jul 15 19:56:29.654487 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.654463    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:56:29.689379 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.689348    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls\") pod \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") "
Jul 15 19:56:29.689573 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.689398    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-bound-sa-token\") pod \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") "
Jul 15 19:56:29.689573 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.689419    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2phc\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-kube-api-access-r2phc\") pod \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") "
Jul 15 19:56:29.689573 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.689446    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-certificates\") pod \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") "
Jul 15 19:56:29.689573 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.689473    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-installation-pull-secrets\") pod \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") "
Jul 15 19:56:29.689573 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.689494    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-image-registry-private-configuration\") pod \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") "
Jul 15 19:56:29.689573 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.689540    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-ca-trust-extracted\") pod \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") "
Jul 15 19:56:29.689573 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.689572    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-trusted-ca\") pod \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\" (UID: \"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8\") "
Jul 15 19:56:29.690109 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.690036    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:56:29.690455 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.690245    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:56:29.692127 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.692075    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:56:29.692236 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.692210    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:56:29.692302 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.692269    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:56:29.692542 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.692516    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-kube-api-access-r2phc" (OuterVolumeSpecName: "kube-api-access-r2phc") pod "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8"). InnerVolumeSpecName "kube-api-access-r2phc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:56:29.692688 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.692673    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:56:29.698135 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.698114    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" (UID: "0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:56:29.790803 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.790764    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:56:29.790803 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.790803    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-bound-sa-token\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:56:29.791057 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.790817    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2phc\" (UniqueName: \"kubernetes.io/projected/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-kube-api-access-r2phc\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:56:29.791057 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.790830    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-registry-certificates\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:56:29.791057 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.790842    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-installation-pull-secrets\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:56:29.791057 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.790856    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-image-registry-private-configuration\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:56:29.791057 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.790869    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-ca-trust-extracted\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:56:29.791057 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:29.790880    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8-trusted-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:56:30.453455 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:30.453392    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-48n48" event={"ID":"746ed836-caef-44c2-8176-39afca487957","Type":"ContainerStarted","Data":"b519a95386f75fabb3d891e1e00fd2b8e1442fc743701db889d21a749b49546d"}
Jul 15 19:56:30.454726 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:30.454695    2560 generic.go:356] "Generic (PLEG): container finished" podID="0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" containerID="513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2" exitCode=0
Jul 15 19:56:30.454862 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:30.454745    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8489687fcb-dch2g"
Jul 15 19:56:30.454862 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:30.454750    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8489687fcb-dch2g" event={"ID":"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8","Type":"ContainerDied","Data":"513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2"}
Jul 15 19:56:30.454862 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:30.454856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8489687fcb-dch2g" event={"ID":"0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8","Type":"ContainerDied","Data":"94e34c5a38c70af7657a58d3ae352bca6603cc51408aa3140c04e8af5494638e"}
Jul 15 19:56:30.455040 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:30.454885    2560 scope.go:117] "RemoveContainer" containerID="513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2"
Jul 15 19:56:30.464079 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:30.464050    2560 scope.go:117] "RemoveContainer" containerID="513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2"
Jul 15 19:56:30.464699 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:56:30.464661    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2\": container with ID starting with 513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2 not found: ID does not exist" containerID="513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2"
Jul 15 19:56:30.464783 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:30.464712    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2"} err="failed to get container status \"513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2\": rpc error: code = NotFound desc = could not find container \"513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2\": container with ID starting with 513c4a85635a3031dc834d7fd46e8266fdccc4a12a2c3769963acc3cf21359a2 not found: ID does not exist"
Jul 15 19:56:30.527602 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:30.527574    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8489687fcb-dch2g"]
Jul 15 19:56:30.532861 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:30.532827    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8489687fcb-dch2g"]
Jul 15 19:56:30.894779 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:30.894751    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" path="/var/lib/kubelet/pods/0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8/volumes"
Jul 15 19:56:32.619176 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:32.619135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:56:32.621956 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:32.621912    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15aacac-717b-4c46-866c-1c0d823ebd4a-metrics-certs\") pod \"network-metrics-daemon-vtgkp\" (UID: \"d15aacac-717b-4c46-866c-1c0d823ebd4a\") " pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:56:32.703814 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:32.703778    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sjg99\""
Jul 15 19:56:32.708840 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:32.708810    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vtgkp"
Jul 15 19:56:32.930190 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:32.930113    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vtgkp"]
Jul 15 19:56:32.933528 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:56:32.933500    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd15aacac_717b_4c46_866c_1c0d823ebd4a.slice/crio-71b281d680d4e54c51d200f38709d4f9b13d11127f078d53af65ada7b78ca1da WatchSource:0}: Error finding container 71b281d680d4e54c51d200f38709d4f9b13d11127f078d53af65ada7b78ca1da: Status 404 returned error can't find the container with id 71b281d680d4e54c51d200f38709d4f9b13d11127f078d53af65ada7b78ca1da
Jul 15 19:56:33.469305 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:33.469270    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vtgkp" event={"ID":"d15aacac-717b-4c46-866c-1c0d823ebd4a","Type":"ContainerStarted","Data":"71b281d680d4e54c51d200f38709d4f9b13d11127f078d53af65ada7b78ca1da"}
Jul 15 19:56:35.479715 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:35.479675    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vtgkp" event={"ID":"d15aacac-717b-4c46-866c-1c0d823ebd4a","Type":"ContainerStarted","Data":"389550f356f40f87e5da249cf2ea620a653199b4d6e5a0a057154f3f02d32c2f"}
Jul 15 19:56:35.480185 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:35.479742    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vtgkp" event={"ID":"d15aacac-717b-4c46-866c-1c0d823ebd4a","Type":"ContainerStarted","Data":"cdf2b95ec23eaa55fd4b3e01b05e4de627879c164ef167600be7ad78d80c0bec"}
Jul 15 19:56:35.512674 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:35.512603    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vtgkp" podStartSLOduration=130.917935361 podStartE2EDuration="2m12.512582507s" totalImagesPullingTime="1.594647146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:35.510457569 +0000 UTC m=+133.147574870" watchObservedRunningTime="2026-07-15 19:56:35.512582507 +0000 UTC m=+133.149699799"
Jul 15 19:56:38.709597 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.709556    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dbd87f4fb-svt6k"]
Jul 15 19:56:38.710082 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.709923    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" containerName="registry"
Jul 15 19:56:38.710082 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.709961    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" containerName="registry"
Jul 15 19:56:38.710082 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.710037    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea7e4b6-c8b1-4bb8-86b7-f54dcaf16ee8" containerName="registry"
Jul 15 19:56:38.724058 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.724032    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.726119 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.726092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dbd87f4fb-svt6k"]
Jul 15 19:56:38.729772 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.729495    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4lxl7\""
Jul 15 19:56:38.729772 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.729524    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 19:56:38.729772 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.729495    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 19:56:38.730017 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.729861    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 19:56:38.730017 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.729886    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 19:56:38.730017 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.729978    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 19:56:38.772924 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.772893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-config\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.773083 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.772989    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-service-ca\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.773083 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.773018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-serving-cert\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.773083 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.773043    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-oauth-serving-cert\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.773083 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.773068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw9vs\" (UniqueName: \"kubernetes.io/projected/67d1641f-01fa-4dfa-9b3e-21c05f82f007-kube-api-access-mw9vs\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.773239 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.773113    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-oauth-config\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.874452 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.874415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-oauth-config\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.874609 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.874482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-config\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.874609 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.874544    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-service-ca\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.874609 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.874569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-serving-cert\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.874609 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.874593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-oauth-serving-cert\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.874799 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.874617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw9vs\" (UniqueName: \"kubernetes.io/projected/67d1641f-01fa-4dfa-9b3e-21c05f82f007-kube-api-access-mw9vs\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.875430 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.875409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-service-ca\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.875529 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.875463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-oauth-serving-cert\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.875571 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.875476    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-config\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.877337 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.877318    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-oauth-config\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.877555 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.877538    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-serving-cert\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:38.893975 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:38.893928    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw9vs\" (UniqueName: \"kubernetes.io/projected/67d1641f-01fa-4dfa-9b3e-21c05f82f007-kube-api-access-mw9vs\") pod \"console-7dbd87f4fb-svt6k\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") " pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:39.034125 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:39.034039    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:39.181418 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:39.181390    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dbd87f4fb-svt6k"]
Jul 15 19:56:39.184588 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:56:39.184556    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d1641f_01fa_4dfa_9b3e_21c05f82f007.slice/crio-a958de6012a245313a85260b497fee3861379a45242d5f55905c706f7ca23b9b WatchSource:0}: Error finding container a958de6012a245313a85260b497fee3861379a45242d5f55905c706f7ca23b9b: Status 404 returned error can't find the container with id a958de6012a245313a85260b497fee3861379a45242d5f55905c706f7ca23b9b
Jul 15 19:56:39.496037 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:39.495998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbd87f4fb-svt6k" event={"ID":"67d1641f-01fa-4dfa-9b3e-21c05f82f007","Type":"ContainerStarted","Data":"a958de6012a245313a85260b497fee3861379a45242d5f55905c706f7ca23b9b"}
Jul 15 19:56:47.529244 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:47.529164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-48n48" event={"ID":"746ed836-caef-44c2-8176-39afca487957","Type":"ContainerStarted","Data":"4d5f11194d525d8566116fb8d92b6ab3d9cef8c3e29a01c3562171144c09afa5"}
Jul 15 19:56:47.530003 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:47.529422    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-48n48"
Jul 15 19:56:47.537975 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:47.537928    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-48n48"
Jul 15 19:56:47.555440 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:47.554840    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-48n48" podStartSLOduration=1.289379773 podStartE2EDuration="18.554819873s" totalImagesPullingTime="17.2654401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:47.55250348 +0000 UTC m=+145.189620773" watchObservedRunningTime="2026-07-15 19:56:47.554819873 +0000 UTC m=+145.191937159"
Jul 15 19:56:48.267706 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.267317    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-755f96bc94-zlb98"]
Jul 15 19:56:48.270503 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.269786    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.279390 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.279363    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 19:56:48.282597 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.282538    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755f96bc94-zlb98"]
Jul 15 19:56:48.360414 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.360373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-service-ca\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.360678 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.360424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-config\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.360678 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.360456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z74xk\" (UniqueName: \"kubernetes.io/projected/4a5d7108-dda3-481d-9e44-c5743df6f12a-kube-api-access-z74xk\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.360678 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.360488    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-oauth-config\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.360678 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.360519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-serving-cert\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.360678 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.360549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-trusted-ca-bundle\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.360678 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.360613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-oauth-serving-cert\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.462154 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.461669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-oauth-serving-cert\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.462154 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.461755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-service-ca\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.462154 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.461781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-config\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.462154 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.461804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z74xk\" (UniqueName: \"kubernetes.io/projected/4a5d7108-dda3-481d-9e44-c5743df6f12a-kube-api-access-z74xk\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.462154 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.461837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-oauth-config\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.462154 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.461870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-serving-cert\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.462154 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.461900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-trusted-ca-bundle\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.462652 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.462519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-config\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.462652 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.462519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-oauth-serving-cert\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.463142 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.463118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-service-ca\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.464280 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.464249    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-trusted-ca-bundle\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.465199 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.465158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-oauth-config\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.466245 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.466220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-serving-cert\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.472748 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.472728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z74xk\" (UniqueName: \"kubernetes.io/projected/4a5d7108-dda3-481d-9e44-c5743df6f12a-kube-api-access-z74xk\") pod \"console-755f96bc94-zlb98\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") " pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:48.536182 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.536083    2560 generic.go:356] "Generic (PLEG): container finished" podID="12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2" containerID="7c812868303921aa78136cfbd9d889a8875913ac959635929922b30109250937" exitCode=0
Jul 15 19:56:48.536182 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.536161    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5" event={"ID":"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2","Type":"ContainerDied","Data":"7c812868303921aa78136cfbd9d889a8875913ac959635929922b30109250937"}
Jul 15 19:56:48.536753 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.536731    2560 scope.go:117] "RemoveContainer" containerID="7c812868303921aa78136cfbd9d889a8875913ac959635929922b30109250937"
Jul 15 19:56:48.586184 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:48.585892    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:49.833176 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:49.833141    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755f96bc94-zlb98"]
Jul 15 19:56:49.836894 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:56:49.836854    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5d7108_dda3_481d_9e44_c5743df6f12a.slice/crio-4008142643f444041f027fddf9b51150f468899a2c57eeeefe00711944cdafc3 WatchSource:0}: Error finding container 4008142643f444041f027fddf9b51150f468899a2c57eeeefe00711944cdafc3: Status 404 returned error can't find the container with id 4008142643f444041f027fddf9b51150f468899a2c57eeeefe00711944cdafc3
Jul 15 19:56:50.546142 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:50.546064    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755f96bc94-zlb98" event={"ID":"4a5d7108-dda3-481d-9e44-c5743df6f12a","Type":"ContainerStarted","Data":"4008142643f444041f027fddf9b51150f468899a2c57eeeefe00711944cdafc3"}
Jul 15 19:56:50.548348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:50.548312    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wswf5" event={"ID":"12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2","Type":"ContainerStarted","Data":"40f0e83d3ae52385bc9c0397d42d148e2b82fff0edc115ba3a118195f3d4275d"}
Jul 15 19:56:50.550036 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:50.550008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbd87f4fb-svt6k" event={"ID":"67d1641f-01fa-4dfa-9b3e-21c05f82f007","Type":"ContainerStarted","Data":"930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945"}
Jul 15 19:56:50.587301 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:50.587244    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dbd87f4fb-svt6k" podStartSLOduration=1.712755158 podStartE2EDuration="12.587228095s" totalImagesPullingTime="10.874472937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:56:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:50.586670384 +0000 UTC m=+148.223787677" watchObservedRunningTime="2026-07-15 19:56:50.587228095 +0000 UTC m=+148.224345385"
Jul 15 19:56:51.556741 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:51.556703    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755f96bc94-zlb98" event={"ID":"4a5d7108-dda3-481d-9e44-c5743df6f12a","Type":"ContainerStarted","Data":"84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86"}
Jul 15 19:56:51.579103 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:51.579043    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-755f96bc94-zlb98" podStartSLOduration=2.821125468 podStartE2EDuration="3.579021544s" totalImagesPullingTime="757.896076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:51.577843473 +0000 UTC m=+149.214960763" watchObservedRunningTime="2026-07-15 19:56:51.579021544 +0000 UTC m=+149.216138834"
Jul 15 19:56:58.587344 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:58.587316    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:58.587856 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:58.587413    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:58.592273 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:58.592254    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:59.035102 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:59.035071    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:59.035284 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:59.035265    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:59.039768 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:59.039751    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:59.588760 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:59.588729    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:56:59.589285 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:59.589263    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:56:59.677948 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:56:59.677894    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dbd87f4fb-svt6k"]
Jul 15 19:57:13.636766 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:13.635284    2560 generic.go:356] "Generic (PLEG): container finished" podID="90357708-bc2c-41b6-bbe1-13c770dbe384" containerID="ae2635d8948b34f2d597d6e967ba647364f4c9e1f197cafe0bc5afa4dcf5bafe" exitCode=0
Jul 15 19:57:13.636766 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:13.635376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh" event={"ID":"90357708-bc2c-41b6-bbe1-13c770dbe384","Type":"ContainerDied","Data":"ae2635d8948b34f2d597d6e967ba647364f4c9e1f197cafe0bc5afa4dcf5bafe"}
Jul 15 19:57:13.636766 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:13.635796    2560 scope.go:117] "RemoveContainer" containerID="ae2635d8948b34f2d597d6e967ba647364f4c9e1f197cafe0bc5afa4dcf5bafe"
Jul 15 19:57:14.640897 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:14.640866    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7fkxh" event={"ID":"90357708-bc2c-41b6-bbe1-13c770dbe384","Type":"ContainerStarted","Data":"5d234120f8ef3b3860032434bec6231701b8ea3fd1e8383f4a342025e1a38475"}
Jul 15 19:57:26.613547 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.613460    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dbd87f4fb-svt6k" podUID="67d1641f-01fa-4dfa-9b3e-21c05f82f007" containerName="console" containerID="cri-o://930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945" gracePeriod=15
Jul 15 19:57:26.916468 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.916113    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:57:26.951317 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.951279    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-oauth-serving-cert\") pod \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") "
Jul 15 19:57:26.951317 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.951314    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-service-ca\") pod \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") "
Jul 15 19:57:26.951539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.951347    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-config\") pod \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") "
Jul 15 19:57:26.951539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.951392    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-oauth-config\") pod \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") "
Jul 15 19:57:26.951539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.951462    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-serving-cert\") pod \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") "
Jul 15 19:57:26.951539 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.951486    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw9vs\" (UniqueName: \"kubernetes.io/projected/67d1641f-01fa-4dfa-9b3e-21c05f82f007-kube-api-access-mw9vs\") pod \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\" (UID: \"67d1641f-01fa-4dfa-9b3e-21c05f82f007\") "
Jul 15 19:57:26.951742 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.951713    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "67d1641f-01fa-4dfa-9b3e-21c05f82f007" (UID: "67d1641f-01fa-4dfa-9b3e-21c05f82f007"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:57:26.951798 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.951747    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-service-ca" (OuterVolumeSpecName: "service-ca") pod "67d1641f-01fa-4dfa-9b3e-21c05f82f007" (UID: "67d1641f-01fa-4dfa-9b3e-21c05f82f007"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:57:26.951886 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.951863    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-config" (OuterVolumeSpecName: "console-config") pod "67d1641f-01fa-4dfa-9b3e-21c05f82f007" (UID: "67d1641f-01fa-4dfa-9b3e-21c05f82f007"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:57:26.954591 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.954556    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67d1641f-01fa-4dfa-9b3e-21c05f82f007-kube-api-access-mw9vs" (OuterVolumeSpecName: "kube-api-access-mw9vs") pod "67d1641f-01fa-4dfa-9b3e-21c05f82f007" (UID: "67d1641f-01fa-4dfa-9b3e-21c05f82f007"). InnerVolumeSpecName "kube-api-access-mw9vs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:57:26.954591 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.954558    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "67d1641f-01fa-4dfa-9b3e-21c05f82f007" (UID: "67d1641f-01fa-4dfa-9b3e-21c05f82f007"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:57:26.954788 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:26.954650    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "67d1641f-01fa-4dfa-9b3e-21c05f82f007" (UID: "67d1641f-01fa-4dfa-9b3e-21c05f82f007"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:57:27.052721 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.052594    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-oauth-config\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:57:27.052721 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.052634    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-serving-cert\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:57:27.052721 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.052651    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw9vs\" (UniqueName: \"kubernetes.io/projected/67d1641f-01fa-4dfa-9b3e-21c05f82f007-kube-api-access-mw9vs\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:57:27.052721 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.052666    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-oauth-serving-cert\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:57:27.052721 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.052680    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:57:27.052721 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.052694    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67d1641f-01fa-4dfa-9b3e-21c05f82f007-console-config\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:57:27.691547 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.691515    2560 generic.go:356] "Generic (PLEG): container finished" podID="67d1641f-01fa-4dfa-9b3e-21c05f82f007" containerID="930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945" exitCode=0
Jul 15 19:57:27.691964 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.691565    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbd87f4fb-svt6k"
Jul 15 19:57:27.691964 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.691582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbd87f4fb-svt6k" event={"ID":"67d1641f-01fa-4dfa-9b3e-21c05f82f007","Type":"ContainerDied","Data":"930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945"}
Jul 15 19:57:27.691964 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.691623    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbd87f4fb-svt6k" event={"ID":"67d1641f-01fa-4dfa-9b3e-21c05f82f007","Type":"ContainerDied","Data":"a958de6012a245313a85260b497fee3861379a45242d5f55905c706f7ca23b9b"}
Jul 15 19:57:27.691964 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.691642    2560 scope.go:117] "RemoveContainer" containerID="930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945"
Jul 15 19:57:27.700263 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.700243    2560 scope.go:117] "RemoveContainer" containerID="930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945"
Jul 15 19:57:27.700501 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:57:27.700484    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945\": container with ID starting with 930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945 not found: ID does not exist" containerID="930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945"
Jul 15 19:57:27.700536 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.700510    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945"} err="failed to get container status \"930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945\": rpc error: code = NotFound desc = could not find container \"930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945\": container with ID starting with 930b211b7f412a6c543b1de27a46d0e1674ba32aa4d9b0266121582833fcc945 not found: ID does not exist"
Jul 15 19:57:27.715245 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.715221    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dbd87f4fb-svt6k"]
Jul 15 19:57:27.721466 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:27.721439    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dbd87f4fb-svt6k"]
Jul 15 19:57:28.897124 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:28.895044    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67d1641f-01fa-4dfa-9b3e-21c05f82f007" path="/var/lib/kubelet/pods/67d1641f-01fa-4dfa-9b3e-21c05f82f007/volumes"
Jul 15 19:57:47.711248 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.711212    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78577bd864-pnrpx"]
Jul 15 19:57:47.711693 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.711481    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d1641f-01fa-4dfa-9b3e-21c05f82f007" containerName="console"
Jul 15 19:57:47.711693 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.711494    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d1641f-01fa-4dfa-9b3e-21c05f82f007" containerName="console"
Jul 15 19:57:47.711693 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.711547    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="67d1641f-01fa-4dfa-9b3e-21c05f82f007" containerName="console"
Jul 15 19:57:47.713297 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.713281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.734528 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.734491    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78577bd864-pnrpx"]
Jul 15 19:57:47.805630 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.805609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b4190a4-2c10-4824-8eb0-fb066b306945-console-oauth-config\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.805775 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.805642    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b4190a4-2c10-4824-8eb0-fb066b306945-console-serving-cert\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.805775 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.805658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-service-ca\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.805775 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.805681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-console-config\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.805775 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.805747    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-oauth-serving-cert\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.805903 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.805853    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhr7h\" (UniqueName: \"kubernetes.io/projected/4b4190a4-2c10-4824-8eb0-fb066b306945-kube-api-access-mhr7h\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.805903 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.805881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-trusted-ca-bundle\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.906746 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.906723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-console-config\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.906876 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.906753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-oauth-serving-cert\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.906876 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.906790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhr7h\" (UniqueName: \"kubernetes.io/projected/4b4190a4-2c10-4824-8eb0-fb066b306945-kube-api-access-mhr7h\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.906876 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.906821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-trusted-ca-bundle\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.906876 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.906850    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b4190a4-2c10-4824-8eb0-fb066b306945-console-oauth-config\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.907087 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.906891    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b4190a4-2c10-4824-8eb0-fb066b306945-console-serving-cert\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.907087 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.906909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-service-ca\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.907524 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.907500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-console-config\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.907795 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.907566    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-oauth-serving-cert\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.907795 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.907613    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-service-ca\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.907795 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.907761    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-trusted-ca-bundle\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.909459 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.909429    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b4190a4-2c10-4824-8eb0-fb066b306945-console-oauth-config\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.909602 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.909581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b4190a4-2c10-4824-8eb0-fb066b306945-console-serving-cert\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:47.933172 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:47.933154    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhr7h\" (UniqueName: \"kubernetes.io/projected/4b4190a4-2c10-4824-8eb0-fb066b306945-kube-api-access-mhr7h\") pod \"console-78577bd864-pnrpx\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") " pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:48.022302 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:48.022238    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:48.150687 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:48.150656    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78577bd864-pnrpx"]
Jul 15 19:57:48.153363 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:57:48.153337    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4190a4_2c10_4824_8eb0_fb066b306945.slice/crio-f7e19f803a388ec3ad562f610100b0c0867d57e7b56f781ae5c4eddbb7cf4a85 WatchSource:0}: Error finding container f7e19f803a388ec3ad562f610100b0c0867d57e7b56f781ae5c4eddbb7cf4a85: Status 404 returned error can't find the container with id f7e19f803a388ec3ad562f610100b0c0867d57e7b56f781ae5c4eddbb7cf4a85
Jul 15 19:57:48.767760 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:48.767725    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78577bd864-pnrpx" event={"ID":"4b4190a4-2c10-4824-8eb0-fb066b306945","Type":"ContainerStarted","Data":"d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122"}
Jul 15 19:57:48.768204 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:48.767776    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78577bd864-pnrpx" event={"ID":"4b4190a4-2c10-4824-8eb0-fb066b306945","Type":"ContainerStarted","Data":"f7e19f803a388ec3ad562f610100b0c0867d57e7b56f781ae5c4eddbb7cf4a85"}
Jul 15 19:57:48.790909 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:48.790852    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78577bd864-pnrpx" podStartSLOduration=1.79083773 podStartE2EDuration="1.79083773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:57:48.789767278 +0000 UTC m=+206.426884568" watchObservedRunningTime="2026-07-15 19:57:48.79083773 +0000 UTC m=+206.427955019"
Jul 15 19:57:58.022521 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:58.022480    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:58.022521 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:58.022536    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:58.026751 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:58.026732    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:58.804232 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:58.804198    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:57:58.873456 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:57:58.873427    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755f96bc94-zlb98"]
Jul 15 19:58:23.899348 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:23.899294    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-755f96bc94-zlb98" podUID="4a5d7108-dda3-481d-9e44-c5743df6f12a" containerName="console" containerID="cri-o://84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86" gracePeriod=15
Jul 15 19:58:24.137241 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.137215    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:58:24.288281 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.288194    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z74xk\" (UniqueName: \"kubernetes.io/projected/4a5d7108-dda3-481d-9e44-c5743df6f12a-kube-api-access-z74xk\") pod \"4a5d7108-dda3-481d-9e44-c5743df6f12a\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") "
Jul 15 19:58:24.288281 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.288243    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-serving-cert\") pod \"4a5d7108-dda3-481d-9e44-c5743df6f12a\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") "
Jul 15 19:58:24.288491 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.288282    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-trusted-ca-bundle\") pod \"4a5d7108-dda3-481d-9e44-c5743df6f12a\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") "
Jul 15 19:58:24.288491 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.288329    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-config\") pod \"4a5d7108-dda3-481d-9e44-c5743df6f12a\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") "
Jul 15 19:58:24.288491 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.288364    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-oauth-config\") pod \"4a5d7108-dda3-481d-9e44-c5743df6f12a\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") "
Jul 15 19:58:24.288491 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.288401    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-oauth-serving-cert\") pod \"4a5d7108-dda3-481d-9e44-c5743df6f12a\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") "
Jul 15 19:58:24.288491 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.288422    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-service-ca\") pod \"4a5d7108-dda3-481d-9e44-c5743df6f12a\" (UID: \"4a5d7108-dda3-481d-9e44-c5743df6f12a\") "
Jul 15 19:58:24.288891 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.288843    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4a5d7108-dda3-481d-9e44-c5743df6f12a" (UID: "4a5d7108-dda3-481d-9e44-c5743df6f12a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:58:24.288891 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.288852    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-config" (OuterVolumeSpecName: "console-config") pod "4a5d7108-dda3-481d-9e44-c5743df6f12a" (UID: "4a5d7108-dda3-481d-9e44-c5743df6f12a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:58:24.289071 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.288858    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4a5d7108-dda3-481d-9e44-c5743df6f12a" (UID: "4a5d7108-dda3-481d-9e44-c5743df6f12a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:58:24.289071 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.288978    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-service-ca" (OuterVolumeSpecName: "service-ca") pod "4a5d7108-dda3-481d-9e44-c5743df6f12a" (UID: "4a5d7108-dda3-481d-9e44-c5743df6f12a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:58:24.290459 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.290438    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a5d7108-dda3-481d-9e44-c5743df6f12a-kube-api-access-z74xk" (OuterVolumeSpecName: "kube-api-access-z74xk") pod "4a5d7108-dda3-481d-9e44-c5743df6f12a" (UID: "4a5d7108-dda3-481d-9e44-c5743df6f12a"). InnerVolumeSpecName "kube-api-access-z74xk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:58:24.291139 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.291111    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4a5d7108-dda3-481d-9e44-c5743df6f12a" (UID: "4a5d7108-dda3-481d-9e44-c5743df6f12a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:58:24.291139 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.291124    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4a5d7108-dda3-481d-9e44-c5743df6f12a" (UID: "4a5d7108-dda3-481d-9e44-c5743df6f12a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:58:24.389291 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.389263    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-oauth-serving-cert\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:58:24.389291 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.389288    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:58:24.389291 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.389298    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z74xk\" (UniqueName: \"kubernetes.io/projected/4a5d7108-dda3-481d-9e44-c5743df6f12a-kube-api-access-z74xk\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:58:24.389476 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.389307    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-serving-cert\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:58:24.389476 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.389316    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-trusted-ca-bundle\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:58:24.389476 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.389324    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-config\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:58:24.389476 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.389332    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a5d7108-dda3-481d-9e44-c5743df6f12a-console-oauth-config\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:58:24.888741 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.888706    2560 generic.go:356] "Generic (PLEG): container finished" podID="4a5d7108-dda3-481d-9e44-c5743df6f12a" containerID="84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86" exitCode=0
Jul 15 19:58:24.888908 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.888820    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755f96bc94-zlb98"
Jul 15 19:58:24.893069 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.893042    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755f96bc94-zlb98" event={"ID":"4a5d7108-dda3-481d-9e44-c5743df6f12a","Type":"ContainerDied","Data":"84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86"}
Jul 15 19:58:24.893207 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.893079    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755f96bc94-zlb98" event={"ID":"4a5d7108-dda3-481d-9e44-c5743df6f12a","Type":"ContainerDied","Data":"4008142643f444041f027fddf9b51150f468899a2c57eeeefe00711944cdafc3"}
Jul 15 19:58:24.893207 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.893100    2560 scope.go:117] "RemoveContainer" containerID="84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86"
Jul 15 19:58:24.902494 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.902360    2560 scope.go:117] "RemoveContainer" containerID="84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86"
Jul 15 19:58:24.902683 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:58:24.902591    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86\": container with ID starting with 84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86 not found: ID does not exist" containerID="84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86"
Jul 15 19:58:24.902683 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.902616    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86"} err="failed to get container status \"84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86\": rpc error: code = NotFound desc = could not find container \"84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86\": container with ID starting with 84fabdaeed981a486bbb62f9a07a355cf72825e8ca7b89c069b5100e0d6e9c86 not found: ID does not exist"
Jul 15 19:58:24.912792 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.912773    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755f96bc94-zlb98"]
Jul 15 19:58:24.916036 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:24.916017    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-755f96bc94-zlb98"]
Jul 15 19:58:26.897992 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:26.897958    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a5d7108-dda3-481d-9e44-c5743df6f12a" path="/var/lib/kubelet/pods/4a5d7108-dda3-481d-9e44-c5743df6f12a/volumes"
Jul 15 19:58:57.795592 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.795559    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-769f77b954-qpszl"]
Jul 15 19:58:57.796066 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.795802    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a5d7108-dda3-481d-9e44-c5743df6f12a" containerName="console"
Jul 15 19:58:57.796066 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.795813    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a5d7108-dda3-481d-9e44-c5743df6f12a" containerName="console"
Jul 15 19:58:57.796066 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.795882    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a5d7108-dda3-481d-9e44-c5743df6f12a" containerName="console"
Jul 15 19:58:57.797717 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.797702    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.820222 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.820193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-service-ca\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.820347 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.820225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-oauth-serving-cert\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.820347 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.820247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shlf2\" (UniqueName: \"kubernetes.io/projected/e3092602-9d5c-4442-8341-f29a69cb7c56-kube-api-access-shlf2\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.820347 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.820315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3092602-9d5c-4442-8341-f29a69cb7c56-console-oauth-config\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.820456 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.820347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-trusted-ca-bundle\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.820456 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.820371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3092602-9d5c-4442-8341-f29a69cb7c56-console-serving-cert\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.820456 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.820385    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-console-config\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.827416 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.827395    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769f77b954-qpszl"]
Jul 15 19:58:57.920862 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.920836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-trusted-ca-bundle\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.920862 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.920867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3092602-9d5c-4442-8341-f29a69cb7c56-console-serving-cert\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.921054 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.920884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-console-config\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.921054 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.920908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-service-ca\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.921183 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.921163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-oauth-serving-cert\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.921233 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.921211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shlf2\" (UniqueName: \"kubernetes.io/projected/e3092602-9d5c-4442-8341-f29a69cb7c56-kube-api-access-shlf2\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.921285 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.921247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3092602-9d5c-4442-8341-f29a69cb7c56-console-oauth-config\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.921673 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.921648    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-service-ca\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.921789 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.921648    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-console-config\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.921844 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.921799    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-trusted-ca-bundle\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.922089 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.922064    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-oauth-serving-cert\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.923623 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.923605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3092602-9d5c-4442-8341-f29a69cb7c56-console-serving-cert\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.923708 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.923658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3092602-9d5c-4442-8341-f29a69cb7c56-console-oauth-config\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:57.944819 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:57.944791    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shlf2\" (UniqueName: \"kubernetes.io/projected/e3092602-9d5c-4442-8341-f29a69cb7c56-kube-api-access-shlf2\") pod \"console-769f77b954-qpszl\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") " pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:58.106950 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:58.106903    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:58:58.241338 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:58.241307    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769f77b954-qpszl"]
Jul 15 19:58:58.244268 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:58:58.244239    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3092602_9d5c_4442_8341_f29a69cb7c56.slice/crio-4c7f3e2e2237b04bdb7cdaf53de6824fa7e97499b50331babfb644c1286c3fd3 WatchSource:0}: Error finding container 4c7f3e2e2237b04bdb7cdaf53de6824fa7e97499b50331babfb644c1286c3fd3: Status 404 returned error can't find the container with id 4c7f3e2e2237b04bdb7cdaf53de6824fa7e97499b50331babfb644c1286c3fd3
Jul 15 19:58:59.009304 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:59.009266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769f77b954-qpszl" event={"ID":"e3092602-9d5c-4442-8341-f29a69cb7c56","Type":"ContainerStarted","Data":"989c4350563bd4948b41137c3295261482bbbf87a9355ccbe235be25326ac7c4"}
Jul 15 19:58:59.009669 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:59.009323    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769f77b954-qpszl" event={"ID":"e3092602-9d5c-4442-8341-f29a69cb7c56","Type":"ContainerStarted","Data":"4c7f3e2e2237b04bdb7cdaf53de6824fa7e97499b50331babfb644c1286c3fd3"}
Jul 15 19:58:59.034139 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:58:59.034097    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-769f77b954-qpszl" podStartSLOduration=2.034082953 podStartE2EDuration="2.034082953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:58:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:58:59.033701278 +0000 UTC m=+276.670818568" watchObservedRunningTime="2026-07-15 19:58:59.034082953 +0000 UTC m=+276.671200242"
Jul 15 19:59:08.107699 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:08.107662    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:59:08.108165 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:08.107752    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:59:08.112455 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:08.112433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:59:09.052174 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:09.052147    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-769f77b954-qpszl"
Jul 15 19:59:09.107568 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:09.107540    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78577bd864-pnrpx"]
Jul 15 19:59:22.715959 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:22.715907    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 19:59:22.718227 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:22.718204    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 19:59:22.722244 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:22.722224    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 19:59:34.127264 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.127210    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78577bd864-pnrpx" podUID="4b4190a4-2c10-4824-8eb0-fb066b306945" containerName="console" containerID="cri-o://d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122" gracePeriod=15
Jul 15 19:59:34.364575 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.364552    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:59:34.491735 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.491651    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-trusted-ca-bundle\") pod \"4b4190a4-2c10-4824-8eb0-fb066b306945\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") "
Jul 15 19:59:34.491735 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.491701    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-console-config\") pod \"4b4190a4-2c10-4824-8eb0-fb066b306945\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") "
Jul 15 19:59:34.491735 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.491729    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-oauth-serving-cert\") pod \"4b4190a4-2c10-4824-8eb0-fb066b306945\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") "
Jul 15 19:59:34.491988 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.491841    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhr7h\" (UniqueName: \"kubernetes.io/projected/4b4190a4-2c10-4824-8eb0-fb066b306945-kube-api-access-mhr7h\") pod \"4b4190a4-2c10-4824-8eb0-fb066b306945\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") "
Jul 15 19:59:34.491988 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.491895    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b4190a4-2c10-4824-8eb0-fb066b306945-console-serving-cert\") pod \"4b4190a4-2c10-4824-8eb0-fb066b306945\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") "
Jul 15 19:59:34.491988 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.491925    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-service-ca\") pod \"4b4190a4-2c10-4824-8eb0-fb066b306945\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") "
Jul 15 19:59:34.492142 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.491992    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b4190a4-2c10-4824-8eb0-fb066b306945-console-oauth-config\") pod \"4b4190a4-2c10-4824-8eb0-fb066b306945\" (UID: \"4b4190a4-2c10-4824-8eb0-fb066b306945\") "
Jul 15 19:59:34.492142 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.492123    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4b4190a4-2c10-4824-8eb0-fb066b306945" (UID: "4b4190a4-2c10-4824-8eb0-fb066b306945"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:59:34.492142 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.492130    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4b4190a4-2c10-4824-8eb0-fb066b306945" (UID: "4b4190a4-2c10-4824-8eb0-fb066b306945"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:59:34.492287 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.492141    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-console-config" (OuterVolumeSpecName: "console-config") pod "4b4190a4-2c10-4824-8eb0-fb066b306945" (UID: "4b4190a4-2c10-4824-8eb0-fb066b306945"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:59:34.492336 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.492323    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-service-ca" (OuterVolumeSpecName: "service-ca") pod "4b4190a4-2c10-4824-8eb0-fb066b306945" (UID: "4b4190a4-2c10-4824-8eb0-fb066b306945"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:59:34.492383 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.492366    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-console-config\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:59:34.492417 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.492391    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-oauth-serving-cert\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:59:34.492417 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.492403    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-trusted-ca-bundle\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:59:34.494067 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.494038    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4190a4-2c10-4824-8eb0-fb066b306945-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4b4190a4-2c10-4824-8eb0-fb066b306945" (UID: "4b4190a4-2c10-4824-8eb0-fb066b306945"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:59:34.494172 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.494074    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4190a4-2c10-4824-8eb0-fb066b306945-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4b4190a4-2c10-4824-8eb0-fb066b306945" (UID: "4b4190a4-2c10-4824-8eb0-fb066b306945"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:59:34.494229 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.494177    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4190a4-2c10-4824-8eb0-fb066b306945-kube-api-access-mhr7h" (OuterVolumeSpecName: "kube-api-access-mhr7h") pod "4b4190a4-2c10-4824-8eb0-fb066b306945" (UID: "4b4190a4-2c10-4824-8eb0-fb066b306945"). InnerVolumeSpecName "kube-api-access-mhr7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:59:34.593239 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.593212    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b4190a4-2c10-4824-8eb0-fb066b306945-console-serving-cert\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:59:34.593239 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.593237    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b4190a4-2c10-4824-8eb0-fb066b306945-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:59:34.593410 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.593251    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b4190a4-2c10-4824-8eb0-fb066b306945-console-oauth-config\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:59:34.593410 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:34.593263    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhr7h\" (UniqueName: \"kubernetes.io/projected/4b4190a4-2c10-4824-8eb0-fb066b306945-kube-api-access-mhr7h\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 19:59:35.143375 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:35.143338    2560 generic.go:356] "Generic (PLEG): container finished" podID="4b4190a4-2c10-4824-8eb0-fb066b306945" containerID="d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122" exitCode=0
Jul 15 19:59:35.143847 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:35.143378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78577bd864-pnrpx" event={"ID":"4b4190a4-2c10-4824-8eb0-fb066b306945","Type":"ContainerDied","Data":"d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122"}
Jul 15 19:59:35.143847 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:35.143403    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78577bd864-pnrpx"
Jul 15 19:59:35.143847 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:35.143465    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78577bd864-pnrpx" event={"ID":"4b4190a4-2c10-4824-8eb0-fb066b306945","Type":"ContainerDied","Data":"f7e19f803a388ec3ad562f610100b0c0867d57e7b56f781ae5c4eddbb7cf4a85"}
Jul 15 19:59:35.143847 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:35.143496    2560 scope.go:117] "RemoveContainer" containerID="d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122"
Jul 15 19:59:35.152045 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:35.151861    2560 scope.go:117] "RemoveContainer" containerID="d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122"
Jul 15 19:59:35.152130 ip-10-0-135-197 kubenswrapper[2560]: E0715 19:59:35.152111    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122\": container with ID starting with d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122 not found: ID does not exist" containerID="d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122"
Jul 15 19:59:35.152172 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:35.152133    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122"} err="failed to get container status \"d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122\": rpc error: code = NotFound desc = could not find container \"d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122\": container with ID starting with d7fb16bf9235c91e7d160a83c2f98645851f28f03f698cbd916f6d8ba14d9122 not found: ID does not exist"
Jul 15 19:59:35.161400 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:35.161377    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78577bd864-pnrpx"]
Jul 15 19:59:35.165503 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:35.165486    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78577bd864-pnrpx"]
Jul 15 19:59:36.893118 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:36.893083    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b4190a4-2c10-4824-8eb0-fb066b306945" path="/var/lib/kubelet/pods/4b4190a4-2c10-4824-8eb0-fb066b306945/volumes"
Jul 15 19:59:57.534703 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.534671    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"]
Jul 15 19:59:57.535145 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.534962    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b4190a4-2c10-4824-8eb0-fb066b306945" containerName="console"
Jul 15 19:59:57.535145 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.534973    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4190a4-2c10-4824-8eb0-fb066b306945" containerName="console"
Jul 15 19:59:57.535145 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.535013    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b4190a4-2c10-4824-8eb0-fb066b306945" containerName="console"
Jul 15 19:59:57.536847 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.536832    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 19:59:57.539452 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.539421    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jqxb9\""
Jul 15 19:59:57.539650 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.539636    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 19:59:57.540554 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.540537    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 19:59:57.546852 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.546830    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"]
Jul 15 19:59:57.659835 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.659801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/475a6b08-86a3-4092-9947-271323f353a2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84\" (UID: \"475a6b08-86a3-4092-9947-271323f353a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 19:59:57.659835 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.659837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smlsh\" (UniqueName: \"kubernetes.io/projected/475a6b08-86a3-4092-9947-271323f353a2-kube-api-access-smlsh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84\" (UID: \"475a6b08-86a3-4092-9947-271323f353a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 19:59:57.660039 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.659866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/475a6b08-86a3-4092-9947-271323f353a2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84\" (UID: \"475a6b08-86a3-4092-9947-271323f353a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 19:59:57.760257 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.760231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/475a6b08-86a3-4092-9947-271323f353a2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84\" (UID: \"475a6b08-86a3-4092-9947-271323f353a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 19:59:57.760340 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.760291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/475a6b08-86a3-4092-9947-271323f353a2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84\" (UID: \"475a6b08-86a3-4092-9947-271323f353a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 19:59:57.760340 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.760308    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smlsh\" (UniqueName: \"kubernetes.io/projected/475a6b08-86a3-4092-9947-271323f353a2-kube-api-access-smlsh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84\" (UID: \"475a6b08-86a3-4092-9947-271323f353a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 19:59:57.760604 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.760588    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/475a6b08-86a3-4092-9947-271323f353a2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84\" (UID: \"475a6b08-86a3-4092-9947-271323f353a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 19:59:57.760639 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.760613    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/475a6b08-86a3-4092-9947-271323f353a2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84\" (UID: \"475a6b08-86a3-4092-9947-271323f353a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 19:59:57.769212 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.769188    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smlsh\" (UniqueName: \"kubernetes.io/projected/475a6b08-86a3-4092-9947-271323f353a2-kube-api-access-smlsh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84\" (UID: \"475a6b08-86a3-4092-9947-271323f353a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 19:59:57.845464 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.845442    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 19:59:57.973566 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.973538    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"]
Jul 15 19:59:57.976961 ip-10-0-135-197 kubenswrapper[2560]: W0715 19:59:57.976911    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475a6b08_86a3_4092_9947_271323f353a2.slice/crio-65a34ff63a4f9f09d2a2019224ef12d573069470362d84ef5f0152ee8dc48a6f WatchSource:0}: Error finding container 65a34ff63a4f9f09d2a2019224ef12d573069470362d84ef5f0152ee8dc48a6f: Status 404 returned error can't find the container with id 65a34ff63a4f9f09d2a2019224ef12d573069470362d84ef5f0152ee8dc48a6f
Jul 15 19:59:57.978972 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:57.978953    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:59:58.222717 ip-10-0-135-197 kubenswrapper[2560]: I0715 19:59:58.222636    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84" event={"ID":"475a6b08-86a3-4092-9947-271323f353a2","Type":"ContainerStarted","Data":"65a34ff63a4f9f09d2a2019224ef12d573069470362d84ef5f0152ee8dc48a6f"}
Jul 15 20:00:04.246425 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:04.246391    2560 generic.go:356] "Generic (PLEG): container finished" podID="475a6b08-86a3-4092-9947-271323f353a2" containerID="e03254859154c3a816953633791e3194aa40211647fcb6d9ebb7a61a2088bf70" exitCode=0
Jul 15 20:00:04.246796 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:04.246488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84" event={"ID":"475a6b08-86a3-4092-9947-271323f353a2","Type":"ContainerDied","Data":"e03254859154c3a816953633791e3194aa40211647fcb6d9ebb7a61a2088bf70"}
Jul 15 20:00:08.262674 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:08.262638    2560 generic.go:356] "Generic (PLEG): container finished" podID="475a6b08-86a3-4092-9947-271323f353a2" containerID="49eb56824341ca32164a58df1f0ac5d53201bfc167aedcd260aa464ad384df7c" exitCode=0
Jul 15 20:00:08.263097 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:08.262726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84" event={"ID":"475a6b08-86a3-4092-9947-271323f353a2","Type":"ContainerDied","Data":"49eb56824341ca32164a58df1f0ac5d53201bfc167aedcd260aa464ad384df7c"}
Jul 15 20:00:14.289651 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:14.289575    2560 generic.go:356] "Generic (PLEG): container finished" podID="475a6b08-86a3-4092-9947-271323f353a2" containerID="e97e06e498f4b0cc4858a35137f33c8b4ca99711bbf0ac06d55d8260e60219f9" exitCode=0
Jul 15 20:00:14.289651 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:14.289636    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84" event={"ID":"475a6b08-86a3-4092-9947-271323f353a2","Type":"ContainerDied","Data":"e97e06e498f4b0cc4858a35137f33c8b4ca99711bbf0ac06d55d8260e60219f9"}
Jul 15 20:00:15.413667 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:15.413642    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 20:00:15.492618 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:15.492589    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/475a6b08-86a3-4092-9947-271323f353a2-bundle\") pod \"475a6b08-86a3-4092-9947-271323f353a2\" (UID: \"475a6b08-86a3-4092-9947-271323f353a2\") "
Jul 15 20:00:15.492618 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:15.492623    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/475a6b08-86a3-4092-9947-271323f353a2-util\") pod \"475a6b08-86a3-4092-9947-271323f353a2\" (UID: \"475a6b08-86a3-4092-9947-271323f353a2\") "
Jul 15 20:00:15.492849 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:15.492661    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smlsh\" (UniqueName: \"kubernetes.io/projected/475a6b08-86a3-4092-9947-271323f353a2-kube-api-access-smlsh\") pod \"475a6b08-86a3-4092-9947-271323f353a2\" (UID: \"475a6b08-86a3-4092-9947-271323f353a2\") "
Jul 15 20:00:15.493327 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:15.493300    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/475a6b08-86a3-4092-9947-271323f353a2-bundle" (OuterVolumeSpecName: "bundle") pod "475a6b08-86a3-4092-9947-271323f353a2" (UID: "475a6b08-86a3-4092-9947-271323f353a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:00:15.494838 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:15.494818    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/475a6b08-86a3-4092-9947-271323f353a2-kube-api-access-smlsh" (OuterVolumeSpecName: "kube-api-access-smlsh") pod "475a6b08-86a3-4092-9947-271323f353a2" (UID: "475a6b08-86a3-4092-9947-271323f353a2"). InnerVolumeSpecName "kube-api-access-smlsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:00:15.498603 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:15.498565    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/475a6b08-86a3-4092-9947-271323f353a2-util" (OuterVolumeSpecName: "util") pod "475a6b08-86a3-4092-9947-271323f353a2" (UID: "475a6b08-86a3-4092-9947-271323f353a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:00:15.593821 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:15.593763    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/475a6b08-86a3-4092-9947-271323f353a2-bundle\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:00:15.593821 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:15.593785    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/475a6b08-86a3-4092-9947-271323f353a2-util\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:00:15.593821 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:15.593794    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smlsh\" (UniqueName: \"kubernetes.io/projected/475a6b08-86a3-4092-9947-271323f353a2-kube-api-access-smlsh\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:00:16.299174 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:16.299143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84" event={"ID":"475a6b08-86a3-4092-9947-271323f353a2","Type":"ContainerDied","Data":"65a34ff63a4f9f09d2a2019224ef12d573069470362d84ef5f0152ee8dc48a6f"}
Jul 15 20:00:16.299317 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:16.299192    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65a34ff63a4f9f09d2a2019224ef12d573069470362d84ef5f0152ee8dc48a6f"
Jul 15 20:00:16.299317 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:16.299150    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5n84"
Jul 15 20:00:21.525201 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.525168    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9"]
Jul 15 20:00:21.525560 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.525405    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="475a6b08-86a3-4092-9947-271323f353a2" containerName="util"
Jul 15 20:00:21.525560 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.525415    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="475a6b08-86a3-4092-9947-271323f353a2" containerName="util"
Jul 15 20:00:21.525560 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.525432    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="475a6b08-86a3-4092-9947-271323f353a2" containerName="pull"
Jul 15 20:00:21.525560 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.525437    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="475a6b08-86a3-4092-9947-271323f353a2" containerName="pull"
Jul 15 20:00:21.525560 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.525444    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="475a6b08-86a3-4092-9947-271323f353a2" containerName="extract"
Jul 15 20:00:21.525560 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.525450    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="475a6b08-86a3-4092-9947-271323f353a2" containerName="extract"
Jul 15 20:00:21.525560 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.525489    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="475a6b08-86a3-4092-9947-271323f353a2" containerName="extract"
Jul 15 20:00:21.528859 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.528842    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9"
Jul 15 20:00:21.531390 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.531369    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 15 20:00:21.531651 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.531635    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lvwvw\""
Jul 15 20:00:21.531884 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.531868    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 15 20:00:21.540909 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.540886    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9"]
Jul 15 20:00:21.637948 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.637908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/648542c5-82b7-4ab4-b019-89f16fb2e9ed-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rbgw9\" (UID: \"648542c5-82b7-4ab4-b019-89f16fb2e9ed\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9"
Jul 15 20:00:21.638131 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.637985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jpwn\" (UniqueName: \"kubernetes.io/projected/648542c5-82b7-4ab4-b019-89f16fb2e9ed-kube-api-access-9jpwn\") pod \"cert-manager-operator-controller-manager-55c444bf86-rbgw9\" (UID: \"648542c5-82b7-4ab4-b019-89f16fb2e9ed\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9"
Jul 15 20:00:21.739185 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.739151    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jpwn\" (UniqueName: \"kubernetes.io/projected/648542c5-82b7-4ab4-b019-89f16fb2e9ed-kube-api-access-9jpwn\") pod \"cert-manager-operator-controller-manager-55c444bf86-rbgw9\" (UID: \"648542c5-82b7-4ab4-b019-89f16fb2e9ed\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9"
Jul 15 20:00:21.739315 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.739230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/648542c5-82b7-4ab4-b019-89f16fb2e9ed-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rbgw9\" (UID: \"648542c5-82b7-4ab4-b019-89f16fb2e9ed\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9"
Jul 15 20:00:21.739550 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.739533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/648542c5-82b7-4ab4-b019-89f16fb2e9ed-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rbgw9\" (UID: \"648542c5-82b7-4ab4-b019-89f16fb2e9ed\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9"
Jul 15 20:00:21.750100 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.750068    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jpwn\" (UniqueName: \"kubernetes.io/projected/648542c5-82b7-4ab4-b019-89f16fb2e9ed-kube-api-access-9jpwn\") pod \"cert-manager-operator-controller-manager-55c444bf86-rbgw9\" (UID: \"648542c5-82b7-4ab4-b019-89f16fb2e9ed\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9"
Jul 15 20:00:21.837671 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.837593    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9"
Jul 15 20:00:21.983976 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:00:21.983920    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648542c5_82b7_4ab4_b019_89f16fb2e9ed.slice/crio-8f4b98ceb8a9e8f29bc2804fffb36b5347d5ac15a1548421835bb1e5e314d736 WatchSource:0}: Error finding container 8f4b98ceb8a9e8f29bc2804fffb36b5347d5ac15a1548421835bb1e5e314d736: Status 404 returned error can't find the container with id 8f4b98ceb8a9e8f29bc2804fffb36b5347d5ac15a1548421835bb1e5e314d736
Jul 15 20:00:21.984075 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:21.984021    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9"]
Jul 15 20:00:22.323640 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:22.323597    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9" event={"ID":"648542c5-82b7-4ab4-b019-89f16fb2e9ed","Type":"ContainerStarted","Data":"8f4b98ceb8a9e8f29bc2804fffb36b5347d5ac15a1548421835bb1e5e314d736"}
Jul 15 20:00:24.334783 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:24.334691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9" event={"ID":"648542c5-82b7-4ab4-b019-89f16fb2e9ed","Type":"ContainerStarted","Data":"ace464c1d467393aaaa1a25a1d93281b7e4898ef67c0127c626ae5b96dfa449b"}
Jul 15 20:00:24.370243 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:24.370191    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbgw9" podStartSLOduration=1.410620048 podStartE2EDuration="3.370176923s" totalImagesPullingTime="1.959556875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:00:24.368369326 +0000 UTC m=+362.005486618" watchObservedRunningTime="2026-07-15 20:00:24.370176923 +0000 UTC m=+362.007294212"
Jul 15 20:00:25.030488 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.030455    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"]
Jul 15 20:00:25.032614 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.032599    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:25.035870 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.035842    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 20:00:25.035870 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.035845    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 20:00:25.036815 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.036796    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jqxb9\""
Jul 15 20:00:25.045390 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.045370    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"]
Jul 15 20:00:25.065281 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.065255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3f0b36b-878e-4547-baa4-e1f019df96a9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh\" (UID: \"a3f0b36b-878e-4547-baa4-e1f019df96a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:25.065385 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.065284    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gbft\" (UniqueName: \"kubernetes.io/projected/a3f0b36b-878e-4547-baa4-e1f019df96a9-kube-api-access-7gbft\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh\" (UID: \"a3f0b36b-878e-4547-baa4-e1f019df96a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:25.065385 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.065317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3f0b36b-878e-4547-baa4-e1f019df96a9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh\" (UID: \"a3f0b36b-878e-4547-baa4-e1f019df96a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:25.166561 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.166534    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3f0b36b-878e-4547-baa4-e1f019df96a9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh\" (UID: \"a3f0b36b-878e-4547-baa4-e1f019df96a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:25.166716 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.166567    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gbft\" (UniqueName: \"kubernetes.io/projected/a3f0b36b-878e-4547-baa4-e1f019df96a9-kube-api-access-7gbft\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh\" (UID: \"a3f0b36b-878e-4547-baa4-e1f019df96a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:25.166716 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.166602    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3f0b36b-878e-4547-baa4-e1f019df96a9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh\" (UID: \"a3f0b36b-878e-4547-baa4-e1f019df96a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:25.166991 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.166974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3f0b36b-878e-4547-baa4-e1f019df96a9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh\" (UID: \"a3f0b36b-878e-4547-baa4-e1f019df96a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:25.167064 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.166987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3f0b36b-878e-4547-baa4-e1f019df96a9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh\" (UID: \"a3f0b36b-878e-4547-baa4-e1f019df96a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:25.189158 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.189129    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gbft\" (UniqueName: \"kubernetes.io/projected/a3f0b36b-878e-4547-baa4-e1f019df96a9-kube-api-access-7gbft\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh\" (UID: \"a3f0b36b-878e-4547-baa4-e1f019df96a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:25.342336 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.342257    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:25.472648 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:25.472625    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"]
Jul 15 20:00:25.474764 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:00:25.474732    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f0b36b_878e_4547_baa4_e1f019df96a9.slice/crio-bc2a28e30b5995085e3c964bacb2ad5ce39b6049ef44cc87b7f8be0b6dcd0065 WatchSource:0}: Error finding container bc2a28e30b5995085e3c964bacb2ad5ce39b6049ef44cc87b7f8be0b6dcd0065: Status 404 returned error can't find the container with id bc2a28e30b5995085e3c964bacb2ad5ce39b6049ef44cc87b7f8be0b6dcd0065
Jul 15 20:00:26.344342 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:26.344308    2560 generic.go:356] "Generic (PLEG): container finished" podID="a3f0b36b-878e-4547-baa4-e1f019df96a9" containerID="9c0838ca2974e95d08e1dd637bf8395edbf4fe92bc206d75526ec7171aa8c2e4" exitCode=0
Jul 15 20:00:26.344721 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:26.344385    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh" event={"ID":"a3f0b36b-878e-4547-baa4-e1f019df96a9","Type":"ContainerDied","Data":"9c0838ca2974e95d08e1dd637bf8395edbf4fe92bc206d75526ec7171aa8c2e4"}
Jul 15 20:00:26.344721 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:26.344447    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh" event={"ID":"a3f0b36b-878e-4547-baa4-e1f019df96a9","Type":"ContainerStarted","Data":"bc2a28e30b5995085e3c964bacb2ad5ce39b6049ef44cc87b7f8be0b6dcd0065"}
Jul 15 20:00:29.358202 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:29.358163    2560 generic.go:356] "Generic (PLEG): container finished" podID="a3f0b36b-878e-4547-baa4-e1f019df96a9" containerID="58eb92b8bbb4f5b5765f5ef5ef5b80d47629c430731ba49b99d8a3c07f3241f6" exitCode=0
Jul 15 20:00:29.358649 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:29.358231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh" event={"ID":"a3f0b36b-878e-4547-baa4-e1f019df96a9","Type":"ContainerDied","Data":"58eb92b8bbb4f5b5765f5ef5ef5b80d47629c430731ba49b99d8a3c07f3241f6"}
Jul 15 20:00:30.366396 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:30.366359    2560 generic.go:356] "Generic (PLEG): container finished" podID="a3f0b36b-878e-4547-baa4-e1f019df96a9" containerID="eed4a22c985b888bae7867f5554e263fbb2d977fbd224c77cbaf9f55553ca947" exitCode=0
Jul 15 20:00:30.366785 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:30.366450    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh" event={"ID":"a3f0b36b-878e-4547-baa4-e1f019df96a9","Type":"ContainerDied","Data":"eed4a22c985b888bae7867f5554e263fbb2d977fbd224c77cbaf9f55553ca947"}
Jul 15 20:00:31.498395 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:31.498368    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:31.614719 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:31.614679    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gbft\" (UniqueName: \"kubernetes.io/projected/a3f0b36b-878e-4547-baa4-e1f019df96a9-kube-api-access-7gbft\") pod \"a3f0b36b-878e-4547-baa4-e1f019df96a9\" (UID: \"a3f0b36b-878e-4547-baa4-e1f019df96a9\") "
Jul 15 20:00:31.614905 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:31.614741    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3f0b36b-878e-4547-baa4-e1f019df96a9-bundle\") pod \"a3f0b36b-878e-4547-baa4-e1f019df96a9\" (UID: \"a3f0b36b-878e-4547-baa4-e1f019df96a9\") "
Jul 15 20:00:31.614905 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:31.614776    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3f0b36b-878e-4547-baa4-e1f019df96a9-util\") pod \"a3f0b36b-878e-4547-baa4-e1f019df96a9\" (UID: \"a3f0b36b-878e-4547-baa4-e1f019df96a9\") "
Jul 15 20:00:31.615143 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:31.615121    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3f0b36b-878e-4547-baa4-e1f019df96a9-bundle" (OuterVolumeSpecName: "bundle") pod "a3f0b36b-878e-4547-baa4-e1f019df96a9" (UID: "a3f0b36b-878e-4547-baa4-e1f019df96a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:00:31.616881 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:31.616861    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3f0b36b-878e-4547-baa4-e1f019df96a9-kube-api-access-7gbft" (OuterVolumeSpecName: "kube-api-access-7gbft") pod "a3f0b36b-878e-4547-baa4-e1f019df96a9" (UID: "a3f0b36b-878e-4547-baa4-e1f019df96a9"). InnerVolumeSpecName "kube-api-access-7gbft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:00:31.621537 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:31.621492    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3f0b36b-878e-4547-baa4-e1f019df96a9-util" (OuterVolumeSpecName: "util") pod "a3f0b36b-878e-4547-baa4-e1f019df96a9" (UID: "a3f0b36b-878e-4547-baa4-e1f019df96a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:00:31.716157 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:31.716128    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3f0b36b-878e-4547-baa4-e1f019df96a9-util\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:00:31.716157 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:31.716153    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gbft\" (UniqueName: \"kubernetes.io/projected/a3f0b36b-878e-4547-baa4-e1f019df96a9-kube-api-access-7gbft\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:00:31.716157 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:31.716164    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3f0b36b-878e-4547-baa4-e1f019df96a9-bundle\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:00:32.376035 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:32.376009    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh"
Jul 15 20:00:32.376224 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:32.376039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnhdvh" event={"ID":"a3f0b36b-878e-4547-baa4-e1f019df96a9","Type":"ContainerDied","Data":"bc2a28e30b5995085e3c964bacb2ad5ce39b6049ef44cc87b7f8be0b6dcd0065"}
Jul 15 20:00:32.376224 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:32.376086    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc2a28e30b5995085e3c964bacb2ad5ce39b6049ef44cc87b7f8be0b6dcd0065"
Jul 15 20:00:36.727652 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.727616    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6b59v"]
Jul 15 20:00:36.728178 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.728008    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3f0b36b-878e-4547-baa4-e1f019df96a9" containerName="extract"
Jul 15 20:00:36.728178 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.728026    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3f0b36b-878e-4547-baa4-e1f019df96a9" containerName="extract"
Jul 15 20:00:36.728178 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.728041    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3f0b36b-878e-4547-baa4-e1f019df96a9" containerName="pull"
Jul 15 20:00:36.728178 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.728049    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3f0b36b-878e-4547-baa4-e1f019df96a9" containerName="pull"
Jul 15 20:00:36.728178 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.728060    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3f0b36b-878e-4547-baa4-e1f019df96a9" containerName="util"
Jul 15 20:00:36.728178 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.728067    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3f0b36b-878e-4547-baa4-e1f019df96a9" containerName="util"
Jul 15 20:00:36.728178 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.728150    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3f0b36b-878e-4547-baa4-e1f019df96a9" containerName="extract"
Jul 15 20:00:36.730114 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.730095    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6b59v"
Jul 15 20:00:36.732777 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.732749    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 20:00:36.732777 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.732765    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zqv9f\""
Jul 15 20:00:36.733567 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.733550    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 20:00:36.740918 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.740893    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6b59v"]
Jul 15 20:00:36.855345 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.855321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zpcb\" (UniqueName: \"kubernetes.io/projected/130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0-kube-api-access-4zpcb\") pod \"cert-manager-55b4d954d5-6b59v\" (UID: \"130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0\") " pod="cert-manager/cert-manager-55b4d954d5-6b59v"
Jul 15 20:00:36.855508 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.855367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0-bound-sa-token\") pod \"cert-manager-55b4d954d5-6b59v\" (UID: \"130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0\") " pod="cert-manager/cert-manager-55b4d954d5-6b59v"
Jul 15 20:00:36.956220 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.956190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zpcb\" (UniqueName: \"kubernetes.io/projected/130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0-kube-api-access-4zpcb\") pod \"cert-manager-55b4d954d5-6b59v\" (UID: \"130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0\") " pod="cert-manager/cert-manager-55b4d954d5-6b59v"
Jul 15 20:00:36.956363 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.956237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0-bound-sa-token\") pod \"cert-manager-55b4d954d5-6b59v\" (UID: \"130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0\") " pod="cert-manager/cert-manager-55b4d954d5-6b59v"
Jul 15 20:00:36.964835 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.964802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0-bound-sa-token\") pod \"cert-manager-55b4d954d5-6b59v\" (UID: \"130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0\") " pod="cert-manager/cert-manager-55b4d954d5-6b59v"
Jul 15 20:00:36.964955 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:36.964910    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zpcb\" (UniqueName: \"kubernetes.io/projected/130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0-kube-api-access-4zpcb\") pod \"cert-manager-55b4d954d5-6b59v\" (UID: \"130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0\") " pod="cert-manager/cert-manager-55b4d954d5-6b59v"
Jul 15 20:00:37.038794 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:37.038711    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6b59v"
Jul 15 20:00:37.189506 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:37.189468    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6b59v"]
Jul 15 20:00:37.192039 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:00:37.192009    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod130ab2f3_a2f9_4161_89aa_21f7d2cb2ab0.slice/crio-6b6df89ac1d6f736ff7364f2170f6fdba485fcc45062a44a7cb50640a437fdf5 WatchSource:0}: Error finding container 6b6df89ac1d6f736ff7364f2170f6fdba485fcc45062a44a7cb50640a437fdf5: Status 404 returned error can't find the container with id 6b6df89ac1d6f736ff7364f2170f6fdba485fcc45062a44a7cb50640a437fdf5
Jul 15 20:00:37.396179 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:37.396151    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6b59v" event={"ID":"130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0","Type":"ContainerStarted","Data":"6b6df89ac1d6f736ff7364f2170f6fdba485fcc45062a44a7cb50640a437fdf5"}
Jul 15 20:00:41.416545 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:41.416511    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6b59v" event={"ID":"130ab2f3-a2f9-4161-89aa-21f7d2cb2ab0","Type":"ContainerStarted","Data":"7e42976cf511b3cf11c123d1c4ea06715efa1897bfe4a0ce2aadd16ddf64bb10"}
Jul 15 20:00:42.727873 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.727821    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6b59v" podStartSLOduration=2.888070914 podStartE2EDuration="6.72780442s" totalImagesPullingTime="3.839733506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:00:41.453448106 +0000 UTC m=+379.090565397" watchObservedRunningTime="2026-07-15 20:00:42.72780442 +0000 UTC m=+380.364921738"
Jul 15 20:00:42.728308 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.728052    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f"]
Jul 15 20:00:42.730301 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.730286    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f"
Jul 15 20:00:42.736919 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.736899    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-t8wrq\""
Jul 15 20:00:42.737133 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.737114    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 20:00:42.737550 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.737537    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 20:00:42.753665 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.753644    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f"]
Jul 15 20:00:42.804989 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.804956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttzn7\" (UniqueName: \"kubernetes.io/projected/ffb2da12-1212-4732-bc9d-0980dd953db3-kube-api-access-ttzn7\") pod \"openshift-lws-operator-fd8ccff4c-gvf5f\" (UID: \"ffb2da12-1212-4732-bc9d-0980dd953db3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f"
Jul 15 20:00:42.804989 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.804992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffb2da12-1212-4732-bc9d-0980dd953db3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gvf5f\" (UID: \"ffb2da12-1212-4732-bc9d-0980dd953db3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f"
Jul 15 20:00:42.906136 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.906109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttzn7\" (UniqueName: \"kubernetes.io/projected/ffb2da12-1212-4732-bc9d-0980dd953db3-kube-api-access-ttzn7\") pod \"openshift-lws-operator-fd8ccff4c-gvf5f\" (UID: \"ffb2da12-1212-4732-bc9d-0980dd953db3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f"
Jul 15 20:00:42.906136 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.906141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffb2da12-1212-4732-bc9d-0980dd953db3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gvf5f\" (UID: \"ffb2da12-1212-4732-bc9d-0980dd953db3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f"
Jul 15 20:00:42.906467 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.906447    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffb2da12-1212-4732-bc9d-0980dd953db3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gvf5f\" (UID: \"ffb2da12-1212-4732-bc9d-0980dd953db3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f"
Jul 15 20:00:42.916399 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:42.916370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttzn7\" (UniqueName: \"kubernetes.io/projected/ffb2da12-1212-4732-bc9d-0980dd953db3-kube-api-access-ttzn7\") pod \"openshift-lws-operator-fd8ccff4c-gvf5f\" (UID: \"ffb2da12-1212-4732-bc9d-0980dd953db3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f"
Jul 15 20:00:43.038570 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:43.038488    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f"
Jul 15 20:00:43.177516 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:43.177486    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f"]
Jul 15 20:00:43.180428 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:00:43.180401    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffb2da12_1212_4732_bc9d_0980dd953db3.slice/crio-cf55e5f123cb87ef89ba7520bc6569ac09f0ed14a904cb8aea3e309c66c5696f WatchSource:0}: Error finding container cf55e5f123cb87ef89ba7520bc6569ac09f0ed14a904cb8aea3e309c66c5696f: Status 404 returned error can't find the container with id cf55e5f123cb87ef89ba7520bc6569ac09f0ed14a904cb8aea3e309c66c5696f
Jul 15 20:00:43.426082 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:43.426045    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f" event={"ID":"ffb2da12-1212-4732-bc9d-0980dd953db3","Type":"ContainerStarted","Data":"cf55e5f123cb87ef89ba7520bc6569ac09f0ed14a904cb8aea3e309c66c5696f"}
Jul 15 20:00:45.436559 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:45.436519    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f" event={"ID":"ffb2da12-1212-4732-bc9d-0980dd953db3","Type":"ContainerStarted","Data":"286811d521dc33cd2b280881c42d31c836ce59a8c1e7dbb810834bc00ad59d22"}
Jul 15 20:00:45.459489 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:45.459437    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvf5f" podStartSLOduration=1.568693905 podStartE2EDuration="3.459418922s" totalImagesPullingTime="1.890725017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:00:45.4576193 +0000 UTC m=+383.094736587" watchObservedRunningTime="2026-07-15 20:00:45.459418922 +0000 UTC m=+383.096536211"
Jul 15 20:00:48.904713 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:48.904675    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"]
Jul 15 20:00:48.922161 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:48.922134    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:00:48.923251 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:48.923228    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"]
Jul 15 20:00:48.924843 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:48.924823    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 20:00:48.925552 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:48.925534    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 20:00:48.925654 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:48.925537    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jqxb9\""
Jul 15 20:00:49.057212 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.057176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqz6g\" (UniqueName: \"kubernetes.io/projected/f209133b-d132-4356-8990-06e6050379f7-kube-api-access-sqz6g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb\" (UID: \"f209133b-d132-4356-8990-06e6050379f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:00:49.057383 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.057225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f209133b-d132-4356-8990-06e6050379f7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb\" (UID: \"f209133b-d132-4356-8990-06e6050379f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:00:49.057383 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.057245    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f209133b-d132-4356-8990-06e6050379f7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb\" (UID: \"f209133b-d132-4356-8990-06e6050379f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:00:49.157653 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.157570    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqz6g\" (UniqueName: \"kubernetes.io/projected/f209133b-d132-4356-8990-06e6050379f7-kube-api-access-sqz6g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb\" (UID: \"f209133b-d132-4356-8990-06e6050379f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:00:49.157653 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.157614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f209133b-d132-4356-8990-06e6050379f7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb\" (UID: \"f209133b-d132-4356-8990-06e6050379f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:00:49.157653 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.157635    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f209133b-d132-4356-8990-06e6050379f7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb\" (UID: \"f209133b-d132-4356-8990-06e6050379f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:00:49.157996 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.157980    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f209133b-d132-4356-8990-06e6050379f7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb\" (UID: \"f209133b-d132-4356-8990-06e6050379f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:00:49.158040 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.158016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f209133b-d132-4356-8990-06e6050379f7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb\" (UID: \"f209133b-d132-4356-8990-06e6050379f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:00:49.166540 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.166511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqz6g\" (UniqueName: \"kubernetes.io/projected/f209133b-d132-4356-8990-06e6050379f7-kube-api-access-sqz6g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb\" (UID: \"f209133b-d132-4356-8990-06e6050379f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:00:49.231624 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.231598    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:00:49.368185 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.364349    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"]
Jul 15 20:00:49.453751 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.453710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb" event={"ID":"f209133b-d132-4356-8990-06e6050379f7","Type":"ContainerStarted","Data":"03ca0596dfc808718100b029c0fc657849aab162212566ffca05f8a52ab293e8"}
Jul 15 20:00:49.453888 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:49.453768    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb" event={"ID":"f209133b-d132-4356-8990-06e6050379f7","Type":"ContainerStarted","Data":"4fc24067cc60b40401c927743ece57b47f2a722739642d07a852e3f827eaf891"}
Jul 15 20:00:50.459564 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:50.459482    2560 generic.go:356] "Generic (PLEG): container finished" podID="f209133b-d132-4356-8990-06e6050379f7" containerID="03ca0596dfc808718100b029c0fc657849aab162212566ffca05f8a52ab293e8" exitCode=0
Jul 15 20:00:50.459919 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:50.459575    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb" event={"ID":"f209133b-d132-4356-8990-06e6050379f7","Type":"ContainerDied","Data":"03ca0596dfc808718100b029c0fc657849aab162212566ffca05f8a52ab293e8"}
Jul 15 20:00:51.466333 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:51.466293    2560 generic.go:356] "Generic (PLEG): container finished" podID="f209133b-d132-4356-8990-06e6050379f7" containerID="184ccc6dbc733a052877c06b97530307a22dda38856177dd4d51fa6d1401c6dc" exitCode=0
Jul 15 20:00:51.466768 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:51.466379    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb" event={"ID":"f209133b-d132-4356-8990-06e6050379f7","Type":"ContainerDied","Data":"184ccc6dbc733a052877c06b97530307a22dda38856177dd4d51fa6d1401c6dc"}
Jul 15 20:00:52.472257 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:52.472225    2560 generic.go:356] "Generic (PLEG): container finished" podID="f209133b-d132-4356-8990-06e6050379f7" containerID="9bcc14473e5a499a22f6b45d930f11af065ed901a970314d4d27299b88a51404" exitCode=0
Jul 15 20:00:52.472604 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:52.472255    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb" event={"ID":"f209133b-d132-4356-8990-06e6050379f7","Type":"ContainerDied","Data":"9bcc14473e5a499a22f6b45d930f11af065ed901a970314d4d27299b88a51404"}
Jul 15 20:00:53.598785 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:53.598759    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:00:53.692066 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:53.692037    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqz6g\" (UniqueName: \"kubernetes.io/projected/f209133b-d132-4356-8990-06e6050379f7-kube-api-access-sqz6g\") pod \"f209133b-d132-4356-8990-06e6050379f7\" (UID: \"f209133b-d132-4356-8990-06e6050379f7\") "
Jul 15 20:00:53.692218 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:53.692122    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f209133b-d132-4356-8990-06e6050379f7-util\") pod \"f209133b-d132-4356-8990-06e6050379f7\" (UID: \"f209133b-d132-4356-8990-06e6050379f7\") "
Jul 15 20:00:53.692218 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:53.692188    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f209133b-d132-4356-8990-06e6050379f7-bundle\") pod \"f209133b-d132-4356-8990-06e6050379f7\" (UID: \"f209133b-d132-4356-8990-06e6050379f7\") "
Jul 15 20:00:53.692854 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:53.692827    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f209133b-d132-4356-8990-06e6050379f7-bundle" (OuterVolumeSpecName: "bundle") pod "f209133b-d132-4356-8990-06e6050379f7" (UID: "f209133b-d132-4356-8990-06e6050379f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:00:53.694222 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:53.694198    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f209133b-d132-4356-8990-06e6050379f7-kube-api-access-sqz6g" (OuterVolumeSpecName: "kube-api-access-sqz6g") pod "f209133b-d132-4356-8990-06e6050379f7" (UID: "f209133b-d132-4356-8990-06e6050379f7"). InnerVolumeSpecName "kube-api-access-sqz6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:00:53.697416 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:53.697397    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f209133b-d132-4356-8990-06e6050379f7-util" (OuterVolumeSpecName: "util") pod "f209133b-d132-4356-8990-06e6050379f7" (UID: "f209133b-d132-4356-8990-06e6050379f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:00:53.793197 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:53.793135    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f209133b-d132-4356-8990-06e6050379f7-bundle\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:00:53.793197 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:53.793158    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqz6g\" (UniqueName: \"kubernetes.io/projected/f209133b-d132-4356-8990-06e6050379f7-kube-api-access-sqz6g\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:00:53.793197 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:53.793167    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f209133b-d132-4356-8990-06e6050379f7-util\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:00:54.485066 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:54.485027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb" event={"ID":"f209133b-d132-4356-8990-06e6050379f7","Type":"ContainerDied","Data":"4fc24067cc60b40401c927743ece57b47f2a722739642d07a852e3f827eaf891"}
Jul 15 20:00:54.485238 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:54.485110    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fc24067cc60b40401c927743ece57b47f2a722739642d07a852e3f827eaf891"
Jul 15 20:00:54.485238 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:00:54.485041    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftj7hb"
Jul 15 20:01:05.854767 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.854735    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"]
Jul 15 20:01:05.855209 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.855012    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f209133b-d132-4356-8990-06e6050379f7" containerName="util"
Jul 15 20:01:05.855209 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.855023    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f209133b-d132-4356-8990-06e6050379f7" containerName="util"
Jul 15 20:01:05.855209 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.855030    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f209133b-d132-4356-8990-06e6050379f7" containerName="extract"
Jul 15 20:01:05.855209 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.855035    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f209133b-d132-4356-8990-06e6050379f7" containerName="extract"
Jul 15 20:01:05.855209 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.855044    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f209133b-d132-4356-8990-06e6050379f7" containerName="pull"
Jul 15 20:01:05.855209 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.855050    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f209133b-d132-4356-8990-06e6050379f7" containerName="pull"
Jul 15 20:01:05.855209 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.855104    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f209133b-d132-4356-8990-06e6050379f7" containerName="extract"
Jul 15 20:01:05.861778 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.861663    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:05.864517 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.864496    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kg598\""
Jul 15 20:01:05.864618 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.864549    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 20:01:05.865102 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.865086    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 20:01:05.865709 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.865696    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 20:01:05.865762 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.865748    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 20:01:05.885831 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.885808    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"]
Jul 15 20:01:05.992640 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.992614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bf483de4-f69e-4e4b-958c-273147d29a81-manifests\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:05.992788 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.992659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf483de4-f69e-4e4b-958c-273147d29a81-tmp\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:05.992788 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.992685    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bf483de4-f69e-4e4b-958c-273147d29a81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:05.992788 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.992741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf483de4-f69e-4e4b-958c-273147d29a81-webhook-cert\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:05.992788 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:05.992776    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5kjm\" (UniqueName: \"kubernetes.io/projected/bf483de4-f69e-4e4b-958c-273147d29a81-kube-api-access-b5kjm\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:06.094070 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.094036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf483de4-f69e-4e4b-958c-273147d29a81-tmp\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:06.094214 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.094081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bf483de4-f69e-4e4b-958c-273147d29a81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:06.094214 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.094112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf483de4-f69e-4e4b-958c-273147d29a81-webhook-cert\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:06.094214 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.094140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5kjm\" (UniqueName: \"kubernetes.io/projected/bf483de4-f69e-4e4b-958c-273147d29a81-kube-api-access-b5kjm\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:06.094214 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.094193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bf483de4-f69e-4e4b-958c-273147d29a81-manifests\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:06.094540 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.094523    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bf483de4-f69e-4e4b-958c-273147d29a81-manifests\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:06.096521 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.096499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf483de4-f69e-4e4b-958c-273147d29a81-tmp\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:06.096846 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.096825    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf483de4-f69e-4e4b-958c-273147d29a81-webhook-cert\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:06.096887 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.096847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bf483de4-f69e-4e4b-958c-273147d29a81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:06.103834 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.103809    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5kjm\" (UniqueName: \"kubernetes.io/projected/bf483de4-f69e-4e4b-958c-273147d29a81-kube-api-access-b5kjm\") pod \"opendatahub-operator-controller-manager-57c4dc5856-z2tsq\" (UID: \"bf483de4-f69e-4e4b-958c-273147d29a81\") " pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:06.171544 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.171479    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:06.308389 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.308348    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"]
Jul 15 20:01:06.312232 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:01:06.312206    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf483de4_f69e_4e4b_958c_273147d29a81.slice/crio-d9951b780411ebae2068759df6323916918c590b3e81f26c2a608dd8d785a087 WatchSource:0}: Error finding container d9951b780411ebae2068759df6323916918c590b3e81f26c2a608dd8d785a087: Status 404 returned error can't find the container with id d9951b780411ebae2068759df6323916918c590b3e81f26c2a608dd8d785a087
Jul 15 20:01:06.536793 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:06.536710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq" event={"ID":"bf483de4-f69e-4e4b-958c-273147d29a81","Type":"ContainerStarted","Data":"d9951b780411ebae2068759df6323916918c590b3e81f26c2a608dd8d785a087"}
Jul 15 20:01:11.562755 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:11.562671    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq" event={"ID":"bf483de4-f69e-4e4b-958c-273147d29a81","Type":"ContainerStarted","Data":"d85a16d1b70857b82ee4c1e42fbe82a1981d57d078c96804b8b16b5e0d7d1482"}
Jul 15 20:01:12.567918 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:12.567883    2560 generic.go:356] "Generic (PLEG): container finished" podID="bf483de4-f69e-4e4b-958c-273147d29a81" containerID="d85a16d1b70857b82ee4c1e42fbe82a1981d57d078c96804b8b16b5e0d7d1482" exitCode=0
Jul 15 20:01:12.568376 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:12.567977    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq" event={"ID":"bf483de4-f69e-4e4b-958c-273147d29a81","Type":"ContainerDied","Data":"d85a16d1b70857b82ee4c1e42fbe82a1981d57d078c96804b8b16b5e0d7d1482"}
Jul 15 20:01:13.574318 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:13.574283    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq" event={"ID":"bf483de4-f69e-4e4b-958c-273147d29a81","Type":"ContainerStarted","Data":"477e12c6e5953c7fa09c8f60bc27f318009eb39d0492c0040d7f3e7281a2b45d"}
Jul 15 20:01:13.574696 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:13.574363    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:13.601747 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:13.601691    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq" podStartSLOduration=2.144204156 podStartE2EDuration="8.601673566s" totalImagesPullingTime="5.375946711s" totalInitContainerRuntime="1.081522699s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:01:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:01:13.599340455 +0000 UTC m=+411.236457744" watchObservedRunningTime="2026-07-15 20:01:13.601673566 +0000 UTC m=+411.238790857"
Jul 15 20:01:24.580644 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:24.580605    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57c4dc5856-z2tsq"
Jul 15 20:01:28.074752 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.074712    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"]
Jul 15 20:01:28.081862 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.081832    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"
Jul 15 20:01:28.084381 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.084358    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 20:01:28.084491 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.084358    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xlz4z\""
Jul 15 20:01:28.085233 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.085221    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 20:01:28.085364 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.085349    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 20:01:28.085413 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.085388    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 20:01:28.108437 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.108407    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"]
Jul 15 20:01:28.169472 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.169432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a26fd03-1b9d-42fd-83d1-8f429dbfa810-tls-certs\") pod \"kube-auth-proxy-7c4bdf9b6b-mqddm\" (UID: \"4a26fd03-1b9d-42fd-83d1-8f429dbfa810\") " pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"
Jul 15 20:01:28.169472 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.169479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a26fd03-1b9d-42fd-83d1-8f429dbfa810-tmp\") pod \"kube-auth-proxy-7c4bdf9b6b-mqddm\" (UID: \"4a26fd03-1b9d-42fd-83d1-8f429dbfa810\") " pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"
Jul 15 20:01:28.169721 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.169575    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgccd\" (UniqueName: \"kubernetes.io/projected/4a26fd03-1b9d-42fd-83d1-8f429dbfa810-kube-api-access-rgccd\") pod \"kube-auth-proxy-7c4bdf9b6b-mqddm\" (UID: \"4a26fd03-1b9d-42fd-83d1-8f429dbfa810\") " pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"
Jul 15 20:01:28.270642 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.270608    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a26fd03-1b9d-42fd-83d1-8f429dbfa810-tls-certs\") pod \"kube-auth-proxy-7c4bdf9b6b-mqddm\" (UID: \"4a26fd03-1b9d-42fd-83d1-8f429dbfa810\") " pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"
Jul 15 20:01:28.270642 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.270646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a26fd03-1b9d-42fd-83d1-8f429dbfa810-tmp\") pod \"kube-auth-proxy-7c4bdf9b6b-mqddm\" (UID: \"4a26fd03-1b9d-42fd-83d1-8f429dbfa810\") " pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"
Jul 15 20:01:28.270889 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.270805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgccd\" (UniqueName: \"kubernetes.io/projected/4a26fd03-1b9d-42fd-83d1-8f429dbfa810-kube-api-access-rgccd\") pod \"kube-auth-proxy-7c4bdf9b6b-mqddm\" (UID: \"4a26fd03-1b9d-42fd-83d1-8f429dbfa810\") " pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"
Jul 15 20:01:28.273058 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.273031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a26fd03-1b9d-42fd-83d1-8f429dbfa810-tmp\") pod \"kube-auth-proxy-7c4bdf9b6b-mqddm\" (UID: \"4a26fd03-1b9d-42fd-83d1-8f429dbfa810\") " pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"
Jul 15 20:01:28.273313 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.273295    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a26fd03-1b9d-42fd-83d1-8f429dbfa810-tls-certs\") pod \"kube-auth-proxy-7c4bdf9b6b-mqddm\" (UID: \"4a26fd03-1b9d-42fd-83d1-8f429dbfa810\") " pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"
Jul 15 20:01:28.287773 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.287752    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgccd\" (UniqueName: \"kubernetes.io/projected/4a26fd03-1b9d-42fd-83d1-8f429dbfa810-kube-api-access-rgccd\") pod \"kube-auth-proxy-7c4bdf9b6b-mqddm\" (UID: \"4a26fd03-1b9d-42fd-83d1-8f429dbfa810\") " pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"
Jul 15 20:01:28.391988 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.391922    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"
Jul 15 20:01:28.527921 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.527894    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm"]
Jul 15 20:01:28.529610 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:01:28.529589    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a26fd03_1b9d_42fd_83d1_8f429dbfa810.slice/crio-3ffb2917afd701912650720cde09cd0cb52acd7bb98fa1c0dd2ab8d75df516fa WatchSource:0}: Error finding container 3ffb2917afd701912650720cde09cd0cb52acd7bb98fa1c0dd2ab8d75df516fa: Status 404 returned error can't find the container with id 3ffb2917afd701912650720cde09cd0cb52acd7bb98fa1c0dd2ab8d75df516fa
Jul 15 20:01:28.638964 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:28.638915    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm" event={"ID":"4a26fd03-1b9d-42fd-83d1-8f429dbfa810","Type":"ContainerStarted","Data":"3ffb2917afd701912650720cde09cd0cb52acd7bb98fa1c0dd2ab8d75df516fa"}
Jul 15 20:01:29.628136 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:29.628101    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fwkqp"]
Jul 15 20:01:29.630167 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:29.630152    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp"
Jul 15 20:01:29.635009 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:29.634984    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-gj5gg\""
Jul 15 20:01:29.635795 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:29.635779    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 20:01:29.651552 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:29.651521    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fwkqp"]
Jul 15 20:01:29.682819 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:29.682790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhjs4\" (UniqueName: \"kubernetes.io/projected/bd917117-5236-4434-a47f-30dc3bb51233-kube-api-access-mhjs4\") pod \"model-serving-api-54d89bd5fc-fwkqp\" (UID: \"bd917117-5236-4434-a47f-30dc3bb51233\") " pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp"
Jul 15 20:01:29.682987 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:29.682831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd917117-5236-4434-a47f-30dc3bb51233-tls-certs\") pod \"model-serving-api-54d89bd5fc-fwkqp\" (UID: \"bd917117-5236-4434-a47f-30dc3bb51233\") " pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp"
Jul 15 20:01:29.783566 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:29.783530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhjs4\" (UniqueName: \"kubernetes.io/projected/bd917117-5236-4434-a47f-30dc3bb51233-kube-api-access-mhjs4\") pod \"model-serving-api-54d89bd5fc-fwkqp\" (UID: \"bd917117-5236-4434-a47f-30dc3bb51233\") " pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp"
Jul 15 20:01:29.783566 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:29.783570    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd917117-5236-4434-a47f-30dc3bb51233-tls-certs\") pod \"model-serving-api-54d89bd5fc-fwkqp\" (UID: \"bd917117-5236-4434-a47f-30dc3bb51233\") " pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp"
Jul 15 20:01:29.786260 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:29.786233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd917117-5236-4434-a47f-30dc3bb51233-tls-certs\") pod \"model-serving-api-54d89bd5fc-fwkqp\" (UID: \"bd917117-5236-4434-a47f-30dc3bb51233\") " pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp"
Jul 15 20:01:29.804180 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:29.804158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhjs4\" (UniqueName: \"kubernetes.io/projected/bd917117-5236-4434-a47f-30dc3bb51233-kube-api-access-mhjs4\") pod \"model-serving-api-54d89bd5fc-fwkqp\" (UID: \"bd917117-5236-4434-a47f-30dc3bb51233\") " pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp"
Jul 15 20:01:29.940538 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:29.940457    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp"
Jul 15 20:01:30.083857 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:30.083824    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fwkqp"]
Jul 15 20:01:30.087011 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:01:30.086976    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd917117_5236_4434_a47f_30dc3bb51233.slice/crio-13352452de145f6fc6e82ff900ef375b35a0e8af0e6fbff31efa78106f2f2d65 WatchSource:0}: Error finding container 13352452de145f6fc6e82ff900ef375b35a0e8af0e6fbff31efa78106f2f2d65: Status 404 returned error can't find the container with id 13352452de145f6fc6e82ff900ef375b35a0e8af0e6fbff31efa78106f2f2d65
Jul 15 20:01:30.650046 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:30.649991    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp" event={"ID":"bd917117-5236-4434-a47f-30dc3bb51233","Type":"ContainerStarted","Data":"13352452de145f6fc6e82ff900ef375b35a0e8af0e6fbff31efa78106f2f2d65"}
Jul 15 20:01:32.659725 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:32.659686    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm" event={"ID":"4a26fd03-1b9d-42fd-83d1-8f429dbfa810","Type":"ContainerStarted","Data":"2a152c1b6db8cdcb9262a4e46becdf239d8ce712d80bd74a705f3683427ebab4"}
Jul 15 20:01:32.685152 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:32.685101    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c4bdf9b6b-mqddm" podStartSLOduration=1.580182491 podStartE2EDuration="4.68508621s" totalImagesPullingTime="3.104903719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:01:32.684436009 +0000 UTC m=+430.321553299" watchObservedRunningTime="2026-07-15 20:01:32.68508621 +0000 UTC m=+430.322203500"
Jul 15 20:01:35.675892 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:35.675860    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp" event={"ID":"bd917117-5236-4434-a47f-30dc3bb51233","Type":"ContainerStarted","Data":"46be2e43fdedc1b9ab0a3ca583aad18c41d6e18c9b6ad81abd74df74d2feac9a"}
Jul 15 20:01:35.676344 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:35.676002    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp"
Jul 15 20:01:35.698099 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:35.698031    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp" podStartSLOduration=2.056568471 podStartE2EDuration="6.698016934s" totalImagesPullingTime="4.641448463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:01:35.69764739 +0000 UTC m=+433.334764682" watchObservedRunningTime="2026-07-15 20:01:35.698016934 +0000 UTC m=+433.335134223"
Jul 15 20:01:35.974407 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:35.974326    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"]
Jul 15 20:01:35.977137 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:35.977121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:35.981718 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:35.981699    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 20:01:35.981814 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:35.981699    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 20:01:35.981814 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:35.981703    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 20:01:35.982603 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:35.982584    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 20:01:35.982692 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:35.982600    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dcj9h\""
Jul 15 20:01:36.003547 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.003521    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"]
Jul 15 20:01:36.037294 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.037268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c36b137a-d964-4cc7-9d9b-a22a254548a1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.037406 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.037314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rdkv\" (UniqueName: \"kubernetes.io/projected/c36b137a-d964-4cc7-9d9b-a22a254548a1-kube-api-access-9rdkv\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.037406 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.037375    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c36b137a-d964-4cc7-9d9b-a22a254548a1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.037478 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.037404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c36b137a-d964-4cc7-9d9b-a22a254548a1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.037478 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.037435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c36b137a-d964-4cc7-9d9b-a22a254548a1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.037478 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.037459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c36b137a-d964-4cc7-9d9b-a22a254548a1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.037565 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.037508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c36b137a-d964-4cc7-9d9b-a22a254548a1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.137848 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.137815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rdkv\" (UniqueName: \"kubernetes.io/projected/c36b137a-d964-4cc7-9d9b-a22a254548a1-kube-api-access-9rdkv\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.137848 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.137850    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c36b137a-d964-4cc7-9d9b-a22a254548a1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.138073 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.137870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c36b137a-d964-4cc7-9d9b-a22a254548a1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.138073 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.137905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c36b137a-d964-4cc7-9d9b-a22a254548a1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.138073 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.137961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c36b137a-d964-4cc7-9d9b-a22a254548a1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.138073 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.137991    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c36b137a-d964-4cc7-9d9b-a22a254548a1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.138073 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.138040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c36b137a-d964-4cc7-9d9b-a22a254548a1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.138602 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.138567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c36b137a-d964-4cc7-9d9b-a22a254548a1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.140431 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.140411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c36b137a-d964-4cc7-9d9b-a22a254548a1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.140624 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.140601    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c36b137a-d964-4cc7-9d9b-a22a254548a1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.140677 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.140659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c36b137a-d964-4cc7-9d9b-a22a254548a1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.140746 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.140724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c36b137a-d964-4cc7-9d9b-a22a254548a1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.153214 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.153188    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c36b137a-d964-4cc7-9d9b-a22a254548a1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.153552 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.153536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rdkv\" (UniqueName: \"kubernetes.io/projected/c36b137a-d964-4cc7-9d9b-a22a254548a1-kube-api-access-9rdkv\") pod \"istiod-openshift-gateway-94bb8fbfd-qgzjt\" (UID: \"c36b137a-d964-4cc7-9d9b-a22a254548a1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.285838 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.285745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:36.428468 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.428440    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"]
Jul 15 20:01:36.430872 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:01:36.430845    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36b137a_d964_4cc7_9d9b_a22a254548a1.slice/crio-b8001db1693bbfb76ce6b186ea96942b06e21df4e5a6bf3a9aeb2f4e42bbc321 WatchSource:0}: Error finding container b8001db1693bbfb76ce6b186ea96942b06e21df4e5a6bf3a9aeb2f4e42bbc321: Status 404 returned error can't find the container with id b8001db1693bbfb76ce6b186ea96942b06e21df4e5a6bf3a9aeb2f4e42bbc321
Jul 15 20:01:36.680811 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:36.680776    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt" event={"ID":"c36b137a-d964-4cc7-9d9b-a22a254548a1","Type":"ContainerStarted","Data":"b8001db1693bbfb76ce6b186ea96942b06e21df4e5a6bf3a9aeb2f4e42bbc321"}
Jul 15 20:01:39.234725 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:39.234678    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 15 20:01:39.234984 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:39.234760    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 15 20:01:39.698202 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:39.698169    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt" event={"ID":"c36b137a-d964-4cc7-9d9b-a22a254548a1","Type":"ContainerStarted","Data":"de543330519c4e1649c278dcde08a4796cf107a569b20cda63fbd345b41d891d"}
Jul 15 20:01:39.698372 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:39.698290    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:39.740252 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:39.740200    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt" podStartSLOduration=1.938626183 podStartE2EDuration="4.740185735s" totalImagesPullingTime="2.801559552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:01:39.738619483 +0000 UTC m=+437.375736775" watchObservedRunningTime="2026-07-15 20:01:39.740185735 +0000 UTC m=+437.377303026"
Jul 15 20:01:40.704629 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:40.704603    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgzjt"
Jul 15 20:01:46.685069 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:01:46.684990    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fwkqp"
Jul 15 20:02:44.647968 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.647911    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"]
Jul 15 20:02:44.650510 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.650494    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:44.652757 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.652732    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 20:02:44.653650 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.653630    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zhckq\""
Jul 15 20:02:44.653781 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.653719    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 20:02:44.662763 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.662741    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"]
Jul 15 20:02:44.756199 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.756171    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b3103ec-7134-40a2-aae8-9532902df2e5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw\" (UID: \"4b3103ec-7134-40a2-aae8-9532902df2e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:44.756199 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.756204    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b3103ec-7134-40a2-aae8-9532902df2e5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw\" (UID: \"4b3103ec-7134-40a2-aae8-9532902df2e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:44.756390 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.756303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf85t\" (UniqueName: \"kubernetes.io/projected/4b3103ec-7134-40a2-aae8-9532902df2e5-kube-api-access-jf85t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw\" (UID: \"4b3103ec-7134-40a2-aae8-9532902df2e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:44.857581 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.857553    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf85t\" (UniqueName: \"kubernetes.io/projected/4b3103ec-7134-40a2-aae8-9532902df2e5-kube-api-access-jf85t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw\" (UID: \"4b3103ec-7134-40a2-aae8-9532902df2e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:44.857728 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.857587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b3103ec-7134-40a2-aae8-9532902df2e5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw\" (UID: \"4b3103ec-7134-40a2-aae8-9532902df2e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:44.857728 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.857608    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b3103ec-7134-40a2-aae8-9532902df2e5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw\" (UID: \"4b3103ec-7134-40a2-aae8-9532902df2e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:44.857971 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.857930    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b3103ec-7134-40a2-aae8-9532902df2e5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw\" (UID: \"4b3103ec-7134-40a2-aae8-9532902df2e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:44.858011 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.857971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b3103ec-7134-40a2-aae8-9532902df2e5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw\" (UID: \"4b3103ec-7134-40a2-aae8-9532902df2e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:44.868239 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.868215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf85t\" (UniqueName: \"kubernetes.io/projected/4b3103ec-7134-40a2-aae8-9532902df2e5-kube-api-access-jf85t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw\" (UID: \"4b3103ec-7134-40a2-aae8-9532902df2e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:44.959651 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:44.959588    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:45.095130 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.095105    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"]
Jul 15 20:02:45.097571 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:02:45.097547    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3103ec_7134_40a2_aae8_9532902df2e5.slice/crio-8f0d9ea3d8327476c8852c9e655903bda4890fb4a876c38c062dd3b3c2184f30 WatchSource:0}: Error finding container 8f0d9ea3d8327476c8852c9e655903bda4890fb4a876c38c062dd3b3c2184f30: Status 404 returned error can't find the container with id 8f0d9ea3d8327476c8852c9e655903bda4890fb4a876c38c062dd3b3c2184f30
Jul 15 20:02:45.458051 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.458017    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"]
Jul 15 20:02:45.460219 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.460203    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:45.470560 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.470537    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"]
Jul 15 20:02:45.564500 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.564473    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8a4e3c8-90d6-493b-8747-9208c283e440-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs\" (UID: \"d8a4e3c8-90d6-493b-8747-9208c283e440\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:45.564647 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.564526    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8a4e3c8-90d6-493b-8747-9208c283e440-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs\" (UID: \"d8a4e3c8-90d6-493b-8747-9208c283e440\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:45.564647 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.564558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjjpm\" (UniqueName: \"kubernetes.io/projected/d8a4e3c8-90d6-493b-8747-9208c283e440-kube-api-access-sjjpm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs\" (UID: \"d8a4e3c8-90d6-493b-8747-9208c283e440\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:45.664915 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.664876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjjpm\" (UniqueName: \"kubernetes.io/projected/d8a4e3c8-90d6-493b-8747-9208c283e440-kube-api-access-sjjpm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs\" (UID: \"d8a4e3c8-90d6-493b-8747-9208c283e440\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:45.665332 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.664984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8a4e3c8-90d6-493b-8747-9208c283e440-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs\" (UID: \"d8a4e3c8-90d6-493b-8747-9208c283e440\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:45.665332 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.665014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8a4e3c8-90d6-493b-8747-9208c283e440-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs\" (UID: \"d8a4e3c8-90d6-493b-8747-9208c283e440\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:45.665332 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.665291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8a4e3c8-90d6-493b-8747-9208c283e440-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs\" (UID: \"d8a4e3c8-90d6-493b-8747-9208c283e440\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:45.665332 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.665327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8a4e3c8-90d6-493b-8747-9208c283e440-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs\" (UID: \"d8a4e3c8-90d6-493b-8747-9208c283e440\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:45.674911 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.674890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjjpm\" (UniqueName: \"kubernetes.io/projected/d8a4e3c8-90d6-493b-8747-9208c283e440-kube-api-access-sjjpm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs\" (UID: \"d8a4e3c8-90d6-493b-8747-9208c283e440\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:45.768646 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.768582    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:45.867984 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.867951    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"]
Jul 15 20:02:45.870629 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.870608    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:45.880977 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.880915    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"]
Jul 15 20:02:45.900201 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.900128    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"]
Jul 15 20:02:45.902540 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:02:45.902517    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a4e3c8_90d6_493b_8747_9208c283e440.slice/crio-2a804da42047ce86d8d5b6f45688c369983957a131c9e6415b0e79597c570b29 WatchSource:0}: Error finding container 2a804da42047ce86d8d5b6f45688c369983957a131c9e6415b0e79597c570b29: Status 404 returned error can't find the container with id 2a804da42047ce86d8d5b6f45688c369983957a131c9e6415b0e79597c570b29
Jul 15 20:02:45.966640 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.966611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88f44f3e-ec88-4fcd-9366-d4321268fb0c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25\" (UID: \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:45.966752 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.966681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88f44f3e-ec88-4fcd-9366-d4321268fb0c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25\" (UID: \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:45.966752 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.966711    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wmwq\" (UniqueName: \"kubernetes.io/projected/88f44f3e-ec88-4fcd-9366-d4321268fb0c-kube-api-access-5wmwq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25\" (UID: \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:45.986071 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.986033    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs" event={"ID":"d8a4e3c8-90d6-493b-8747-9208c283e440","Type":"ContainerStarted","Data":"729c813ac16fa86138c380942b991acdda32d0290aa8a6b054d420550858d619"}
Jul 15 20:02:45.986213 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.986094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs" event={"ID":"d8a4e3c8-90d6-493b-8747-9208c283e440","Type":"ContainerStarted","Data":"2a804da42047ce86d8d5b6f45688c369983957a131c9e6415b0e79597c570b29"}
Jul 15 20:02:45.987742 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.987720    2560 generic.go:356] "Generic (PLEG): container finished" podID="4b3103ec-7134-40a2-aae8-9532902df2e5" containerID="b444e3a8078940c8dcb3880a2c3048e480e29fbb803fc733414c3ccd6ad44cb2" exitCode=0
Jul 15 20:02:45.987842 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.987756    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw" event={"ID":"4b3103ec-7134-40a2-aae8-9532902df2e5","Type":"ContainerDied","Data":"b444e3a8078940c8dcb3880a2c3048e480e29fbb803fc733414c3ccd6ad44cb2"}
Jul 15 20:02:45.987842 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:45.987786    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw" event={"ID":"4b3103ec-7134-40a2-aae8-9532902df2e5","Type":"ContainerStarted","Data":"8f0d9ea3d8327476c8852c9e655903bda4890fb4a876c38c062dd3b3c2184f30"}
Jul 15 20:02:46.068085 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.068017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88f44f3e-ec88-4fcd-9366-d4321268fb0c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25\" (UID: \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:46.068085 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.068054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmwq\" (UniqueName: \"kubernetes.io/projected/88f44f3e-ec88-4fcd-9366-d4321268fb0c-kube-api-access-5wmwq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25\" (UID: \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:46.068283 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.068138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88f44f3e-ec88-4fcd-9366-d4321268fb0c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25\" (UID: \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:46.068406 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.068387    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88f44f3e-ec88-4fcd-9366-d4321268fb0c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25\" (UID: \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:46.068484 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.068465    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88f44f3e-ec88-4fcd-9366-d4321268fb0c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25\" (UID: \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:46.077767 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.077746    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wmwq\" (UniqueName: \"kubernetes.io/projected/88f44f3e-ec88-4fcd-9366-d4321268fb0c-kube-api-access-5wmwq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25\" (UID: \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:46.188337 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.188312    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:46.250581 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.250554    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"]
Jul 15 20:02:46.252975 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.252907    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:46.262318 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.262298    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"]
Jul 15 20:02:46.269679 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.269657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a44afb10-44b0-4a79-a632-06c1f784d07a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7\" (UID: \"a44afb10-44b0-4a79-a632-06c1f784d07a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:46.269773 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.269698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fbsr\" (UniqueName: \"kubernetes.io/projected/a44afb10-44b0-4a79-a632-06c1f784d07a-kube-api-access-4fbsr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7\" (UID: \"a44afb10-44b0-4a79-a632-06c1f784d07a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:46.269773 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.269721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a44afb10-44b0-4a79-a632-06c1f784d07a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7\" (UID: \"a44afb10-44b0-4a79-a632-06c1f784d07a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:46.323480 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.323434    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"]
Jul 15 20:02:46.325598 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:02:46.325575    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f44f3e_ec88_4fcd_9366_d4321268fb0c.slice/crio-166981bd941a03c785d9baf5be2f8e832b2d3d1e6c1495b04daa83224b38b112 WatchSource:0}: Error finding container 166981bd941a03c785d9baf5be2f8e832b2d3d1e6c1495b04daa83224b38b112: Status 404 returned error can't find the container with id 166981bd941a03c785d9baf5be2f8e832b2d3d1e6c1495b04daa83224b38b112
Jul 15 20:02:46.372239 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.371214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a44afb10-44b0-4a79-a632-06c1f784d07a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7\" (UID: \"a44afb10-44b0-4a79-a632-06c1f784d07a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:46.372239 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.371285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fbsr\" (UniqueName: \"kubernetes.io/projected/a44afb10-44b0-4a79-a632-06c1f784d07a-kube-api-access-4fbsr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7\" (UID: \"a44afb10-44b0-4a79-a632-06c1f784d07a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:46.372239 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.371318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a44afb10-44b0-4a79-a632-06c1f784d07a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7\" (UID: \"a44afb10-44b0-4a79-a632-06c1f784d07a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:46.372239 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.371714    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a44afb10-44b0-4a79-a632-06c1f784d07a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7\" (UID: \"a44afb10-44b0-4a79-a632-06c1f784d07a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:46.376415 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.372633    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a44afb10-44b0-4a79-a632-06c1f784d07a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7\" (UID: \"a44afb10-44b0-4a79-a632-06c1f784d07a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:46.380983 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.380959    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fbsr\" (UniqueName: \"kubernetes.io/projected/a44afb10-44b0-4a79-a632-06c1f784d07a-kube-api-access-4fbsr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7\" (UID: \"a44afb10-44b0-4a79-a632-06c1f784d07a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:46.565576 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.565541    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:46.695832 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.695812    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"]
Jul 15 20:02:46.697970 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:02:46.697929    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44afb10_44b0_4a79_a632_06c1f784d07a.slice/crio-67b5c317a0876e25e2bdd77bf992e355eb9ec7b24d601e11ede5b3894742608c WatchSource:0}: Error finding container 67b5c317a0876e25e2bdd77bf992e355eb9ec7b24d601e11ede5b3894742608c: Status 404 returned error can't find the container with id 67b5c317a0876e25e2bdd77bf992e355eb9ec7b24d601e11ede5b3894742608c
Jul 15 20:02:46.993452 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.993424    2560 generic.go:356] "Generic (PLEG): container finished" podID="a44afb10-44b0-4a79-a632-06c1f784d07a" containerID="0fd5ffaf6ed8f45644279adbbee99ae4069847d77d7c7e7a646a0c9e0c3527f9" exitCode=0
Jul 15 20:02:46.993609 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.993505    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7" event={"ID":"a44afb10-44b0-4a79-a632-06c1f784d07a","Type":"ContainerDied","Data":"0fd5ffaf6ed8f45644279adbbee99ae4069847d77d7c7e7a646a0c9e0c3527f9"}
Jul 15 20:02:46.993609 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.993554    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7" event={"ID":"a44afb10-44b0-4a79-a632-06c1f784d07a","Type":"ContainerStarted","Data":"67b5c317a0876e25e2bdd77bf992e355eb9ec7b24d601e11ede5b3894742608c"}
Jul 15 20:02:46.995451 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.995426    2560 generic.go:356] "Generic (PLEG): container finished" podID="4b3103ec-7134-40a2-aae8-9532902df2e5" containerID="e0d60f95abecd014342ae05cb65deb3bfeb85a538f49c64225abba136241f87b" exitCode=0
Jul 15 20:02:46.995575 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.995506    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw" event={"ID":"4b3103ec-7134-40a2-aae8-9532902df2e5","Type":"ContainerDied","Data":"e0d60f95abecd014342ae05cb65deb3bfeb85a538f49c64225abba136241f87b"}
Jul 15 20:02:46.997041 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.997017    2560 generic.go:356] "Generic (PLEG): container finished" podID="88f44f3e-ec88-4fcd-9366-d4321268fb0c" containerID="4716052d8f4f171370c67f7e2990654d32a20cf8bd44a1d6397ac15a4ac5a236" exitCode=0
Jul 15 20:02:46.997120 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.997100    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25" event={"ID":"88f44f3e-ec88-4fcd-9366-d4321268fb0c","Type":"ContainerDied","Data":"4716052d8f4f171370c67f7e2990654d32a20cf8bd44a1d6397ac15a4ac5a236"}
Jul 15 20:02:46.997192 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.997143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25" event={"ID":"88f44f3e-ec88-4fcd-9366-d4321268fb0c","Type":"ContainerStarted","Data":"166981bd941a03c785d9baf5be2f8e832b2d3d1e6c1495b04daa83224b38b112"}
Jul 15 20:02:46.998846 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.998823    2560 generic.go:356] "Generic (PLEG): container finished" podID="d8a4e3c8-90d6-493b-8747-9208c283e440" containerID="729c813ac16fa86138c380942b991acdda32d0290aa8a6b054d420550858d619" exitCode=0
Jul 15 20:02:46.998959 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:46.998884    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs" event={"ID":"d8a4e3c8-90d6-493b-8747-9208c283e440","Type":"ContainerDied","Data":"729c813ac16fa86138c380942b991acdda32d0290aa8a6b054d420550858d619"}
Jul 15 20:02:48.006226 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:48.006200    2560 generic.go:356] "Generic (PLEG): container finished" podID="4b3103ec-7134-40a2-aae8-9532902df2e5" containerID="e24feee64c1a59c2f24e8487bbfd0ea8c5d17a0a9bd55af0cefab7f94254d5f4" exitCode=0
Jul 15 20:02:48.006555 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:48.006290    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw" event={"ID":"4b3103ec-7134-40a2-aae8-9532902df2e5","Type":"ContainerDied","Data":"e24feee64c1a59c2f24e8487bbfd0ea8c5d17a0a9bd55af0cefab7f94254d5f4"}
Jul 15 20:02:48.008042 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:48.008022    2560 generic.go:356] "Generic (PLEG): container finished" podID="88f44f3e-ec88-4fcd-9366-d4321268fb0c" containerID="d2df93c7ffc60fe21810fcbbd3ab04496bada41468908dc82c73b88483758934" exitCode=0
Jul 15 20:02:48.008127 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:48.008097    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25" event={"ID":"88f44f3e-ec88-4fcd-9366-d4321268fb0c","Type":"ContainerDied","Data":"d2df93c7ffc60fe21810fcbbd3ab04496bada41468908dc82c73b88483758934"}
Jul 15 20:02:48.009949 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:48.009913    2560 generic.go:356] "Generic (PLEG): container finished" podID="a44afb10-44b0-4a79-a632-06c1f784d07a" containerID="953b41eaeac1e673e52fbb959c59b3a1cf9b8ff54f750fc0062fe2131a30f329" exitCode=0
Jul 15 20:02:48.010028 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:48.009970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7" event={"ID":"a44afb10-44b0-4a79-a632-06c1f784d07a","Type":"ContainerDied","Data":"953b41eaeac1e673e52fbb959c59b3a1cf9b8ff54f750fc0062fe2131a30f329"}
Jul 15 20:02:49.016632 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.016553    2560 generic.go:356] "Generic (PLEG): container finished" podID="a44afb10-44b0-4a79-a632-06c1f784d07a" containerID="0228ee87088420d6bd7f703b24b6a395b00cade1173dfa872fbd572d2a29ec39" exitCode=0
Jul 15 20:02:49.017054 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.016637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7" event={"ID":"a44afb10-44b0-4a79-a632-06c1f784d07a","Type":"ContainerDied","Data":"0228ee87088420d6bd7f703b24b6a395b00cade1173dfa872fbd572d2a29ec39"}
Jul 15 20:02:49.018602 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.018580    2560 generic.go:356] "Generic (PLEG): container finished" podID="88f44f3e-ec88-4fcd-9366-d4321268fb0c" containerID="aeb359a9ce5bae6ec48e16e1e3a4b3d96a0a43771cc9651d2fe76f2c0dc0dffc" exitCode=0
Jul 15 20:02:49.018718 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.018660    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25" event={"ID":"88f44f3e-ec88-4fcd-9366-d4321268fb0c","Type":"ContainerDied","Data":"aeb359a9ce5bae6ec48e16e1e3a4b3d96a0a43771cc9651d2fe76f2c0dc0dffc"}
Jul 15 20:02:49.020251 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.020231    2560 generic.go:356] "Generic (PLEG): container finished" podID="d8a4e3c8-90d6-493b-8747-9208c283e440" containerID="ed62e7167b29a7ecde9bc23b4af795f9fe40b51f616714d7b220560a6e0b00ea" exitCode=0
Jul 15 20:02:49.020336 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.020295    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs" event={"ID":"d8a4e3c8-90d6-493b-8747-9208c283e440","Type":"ContainerDied","Data":"ed62e7167b29a7ecde9bc23b4af795f9fe40b51f616714d7b220560a6e0b00ea"}
Jul 15 20:02:49.159155 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.159115    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:49.197244 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.197221    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b3103ec-7134-40a2-aae8-9532902df2e5-bundle\") pod \"4b3103ec-7134-40a2-aae8-9532902df2e5\" (UID: \"4b3103ec-7134-40a2-aae8-9532902df2e5\") "
Jul 15 20:02:49.197349 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.197269    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b3103ec-7134-40a2-aae8-9532902df2e5-util\") pod \"4b3103ec-7134-40a2-aae8-9532902df2e5\" (UID: \"4b3103ec-7134-40a2-aae8-9532902df2e5\") "
Jul 15 20:02:49.197349 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.197305    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf85t\" (UniqueName: \"kubernetes.io/projected/4b3103ec-7134-40a2-aae8-9532902df2e5-kube-api-access-jf85t\") pod \"4b3103ec-7134-40a2-aae8-9532902df2e5\" (UID: \"4b3103ec-7134-40a2-aae8-9532902df2e5\") "
Jul 15 20:02:49.197774 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.197742    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3103ec-7134-40a2-aae8-9532902df2e5-bundle" (OuterVolumeSpecName: "bundle") pod "4b3103ec-7134-40a2-aae8-9532902df2e5" (UID: "4b3103ec-7134-40a2-aae8-9532902df2e5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:49.199516 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.199494    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b3103ec-7134-40a2-aae8-9532902df2e5-kube-api-access-jf85t" (OuterVolumeSpecName: "kube-api-access-jf85t") pod "4b3103ec-7134-40a2-aae8-9532902df2e5" (UID: "4b3103ec-7134-40a2-aae8-9532902df2e5"). InnerVolumeSpecName "kube-api-access-jf85t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:02:49.206481 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.206442    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3103ec-7134-40a2-aae8-9532902df2e5-util" (OuterVolumeSpecName: "util") pod "4b3103ec-7134-40a2-aae8-9532902df2e5" (UID: "4b3103ec-7134-40a2-aae8-9532902df2e5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:49.297767 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.297698    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b3103ec-7134-40a2-aae8-9532902df2e5-bundle\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:02:49.297767 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.297720    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b3103ec-7134-40a2-aae8-9532902df2e5-util\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:02:49.297767 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:49.297729    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf85t\" (UniqueName: \"kubernetes.io/projected/4b3103ec-7134-40a2-aae8-9532902df2e5-kube-api-access-jf85t\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:02:50.027167 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.027140    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw"
Jul 15 20:02:50.027167 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.027162    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw" event={"ID":"4b3103ec-7134-40a2-aae8-9532902df2e5","Type":"ContainerDied","Data":"8f0d9ea3d8327476c8852c9e655903bda4890fb4a876c38c062dd3b3c2184f30"}
Jul 15 20:02:50.027614 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.027209    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f0d9ea3d8327476c8852c9e655903bda4890fb4a876c38c062dd3b3c2184f30"
Jul 15 20:02:50.029270 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.029243    2560 generic.go:356] "Generic (PLEG): container finished" podID="d8a4e3c8-90d6-493b-8747-9208c283e440" containerID="7f01797e2e8916c0b62f2cc2ecc5cc8a436b192d8194674d453a52dbca12c454" exitCode=0
Jul 15 20:02:50.029402 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.029276    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs" event={"ID":"d8a4e3c8-90d6-493b-8747-9208c283e440","Type":"ContainerDied","Data":"7f01797e2e8916c0b62f2cc2ecc5cc8a436b192d8194674d453a52dbca12c454"}
Jul 15 20:02:50.160794 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.160770    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:50.194128 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.194107    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:50.203751 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.203730    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88f44f3e-ec88-4fcd-9366-d4321268fb0c-util\") pod \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\" (UID: \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\") "
Jul 15 20:02:50.203863 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.203760    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88f44f3e-ec88-4fcd-9366-d4321268fb0c-bundle\") pod \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\" (UID: \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\") "
Jul 15 20:02:50.203910 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.203879    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wmwq\" (UniqueName: \"kubernetes.io/projected/88f44f3e-ec88-4fcd-9366-d4321268fb0c-kube-api-access-5wmwq\") pod \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\" (UID: \"88f44f3e-ec88-4fcd-9366-d4321268fb0c\") "
Jul 15 20:02:50.204262 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.204239    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f44f3e-ec88-4fcd-9366-d4321268fb0c-bundle" (OuterVolumeSpecName: "bundle") pod "88f44f3e-ec88-4fcd-9366-d4321268fb0c" (UID: "88f44f3e-ec88-4fcd-9366-d4321268fb0c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:50.206112 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.206091    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f44f3e-ec88-4fcd-9366-d4321268fb0c-kube-api-access-5wmwq" (OuterVolumeSpecName: "kube-api-access-5wmwq") pod "88f44f3e-ec88-4fcd-9366-d4321268fb0c" (UID: "88f44f3e-ec88-4fcd-9366-d4321268fb0c"). InnerVolumeSpecName "kube-api-access-5wmwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:02:50.210920 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.210899    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f44f3e-ec88-4fcd-9366-d4321268fb0c-util" (OuterVolumeSpecName: "util") pod "88f44f3e-ec88-4fcd-9366-d4321268fb0c" (UID: "88f44f3e-ec88-4fcd-9366-d4321268fb0c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:50.305236 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.305206    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a44afb10-44b0-4a79-a632-06c1f784d07a-util\") pod \"a44afb10-44b0-4a79-a632-06c1f784d07a\" (UID: \"a44afb10-44b0-4a79-a632-06c1f784d07a\") "
Jul 15 20:02:50.305395 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.305262    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a44afb10-44b0-4a79-a632-06c1f784d07a-bundle\") pod \"a44afb10-44b0-4a79-a632-06c1f784d07a\" (UID: \"a44afb10-44b0-4a79-a632-06c1f784d07a\") "
Jul 15 20:02:50.305395 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.305315    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fbsr\" (UniqueName: \"kubernetes.io/projected/a44afb10-44b0-4a79-a632-06c1f784d07a-kube-api-access-4fbsr\") pod \"a44afb10-44b0-4a79-a632-06c1f784d07a\" (UID: \"a44afb10-44b0-4a79-a632-06c1f784d07a\") "
Jul 15 20:02:50.305503 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.305473    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88f44f3e-ec88-4fcd-9366-d4321268fb0c-util\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:02:50.305503 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.305483    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88f44f3e-ec88-4fcd-9366-d4321268fb0c-bundle\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:02:50.305503 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.305491    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wmwq\" (UniqueName: \"kubernetes.io/projected/88f44f3e-ec88-4fcd-9366-d4321268fb0c-kube-api-access-5wmwq\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:02:50.305858 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.305830    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a44afb10-44b0-4a79-a632-06c1f784d07a-bundle" (OuterVolumeSpecName: "bundle") pod "a44afb10-44b0-4a79-a632-06c1f784d07a" (UID: "a44afb10-44b0-4a79-a632-06c1f784d07a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:50.307526 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.307506    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a44afb10-44b0-4a79-a632-06c1f784d07a-kube-api-access-4fbsr" (OuterVolumeSpecName: "kube-api-access-4fbsr") pod "a44afb10-44b0-4a79-a632-06c1f784d07a" (UID: "a44afb10-44b0-4a79-a632-06c1f784d07a"). InnerVolumeSpecName "kube-api-access-4fbsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:02:50.309950 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.309915    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a44afb10-44b0-4a79-a632-06c1f784d07a-util" (OuterVolumeSpecName: "util") pod "a44afb10-44b0-4a79-a632-06c1f784d07a" (UID: "a44afb10-44b0-4a79-a632-06c1f784d07a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:50.406746 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.406678    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a44afb10-44b0-4a79-a632-06c1f784d07a-bundle\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:02:50.406746 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.406702    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fbsr\" (UniqueName: \"kubernetes.io/projected/a44afb10-44b0-4a79-a632-06c1f784d07a-kube-api-access-4fbsr\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:02:50.406746 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:50.406712    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a44afb10-44b0-4a79-a632-06c1f784d07a-util\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:02:51.035798 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.035773    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7"
Jul 15 20:02:51.036240 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.035779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7" event={"ID":"a44afb10-44b0-4a79-a632-06c1f784d07a","Type":"ContainerDied","Data":"67b5c317a0876e25e2bdd77bf992e355eb9ec7b24d601e11ede5b3894742608c"}
Jul 15 20:02:51.036240 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.035889    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67b5c317a0876e25e2bdd77bf992e355eb9ec7b24d601e11ede5b3894742608c"
Jul 15 20:02:51.037910 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.037889    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25"
Jul 15 20:02:51.038037 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.037981    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25" event={"ID":"88f44f3e-ec88-4fcd-9366-d4321268fb0c","Type":"ContainerDied","Data":"166981bd941a03c785d9baf5be2f8e832b2d3d1e6c1495b04daa83224b38b112"}
Jul 15 20:02:51.038037 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.038015    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="166981bd941a03c785d9baf5be2f8e832b2d3d1e6c1495b04daa83224b38b112"
Jul 15 20:02:51.170572 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.170552    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:51.213727 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.213699    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8a4e3c8-90d6-493b-8747-9208c283e440-bundle\") pod \"d8a4e3c8-90d6-493b-8747-9208c283e440\" (UID: \"d8a4e3c8-90d6-493b-8747-9208c283e440\") "
Jul 15 20:02:51.213894 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.213746    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjjpm\" (UniqueName: \"kubernetes.io/projected/d8a4e3c8-90d6-493b-8747-9208c283e440-kube-api-access-sjjpm\") pod \"d8a4e3c8-90d6-493b-8747-9208c283e440\" (UID: \"d8a4e3c8-90d6-493b-8747-9208c283e440\") "
Jul 15 20:02:51.213894 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.213766    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8a4e3c8-90d6-493b-8747-9208c283e440-util\") pod \"d8a4e3c8-90d6-493b-8747-9208c283e440\" (UID: \"d8a4e3c8-90d6-493b-8747-9208c283e440\") "
Jul 15 20:02:51.214455 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.214378    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8a4e3c8-90d6-493b-8747-9208c283e440-bundle" (OuterVolumeSpecName: "bundle") pod "d8a4e3c8-90d6-493b-8747-9208c283e440" (UID: "d8a4e3c8-90d6-493b-8747-9208c283e440"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:51.215995 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.215969    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8a4e3c8-90d6-493b-8747-9208c283e440-kube-api-access-sjjpm" (OuterVolumeSpecName: "kube-api-access-sjjpm") pod "d8a4e3c8-90d6-493b-8747-9208c283e440" (UID: "d8a4e3c8-90d6-493b-8747-9208c283e440"). InnerVolumeSpecName "kube-api-access-sjjpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:02:51.220119 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.220095    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8a4e3c8-90d6-493b-8747-9208c283e440-util" (OuterVolumeSpecName: "util") pod "d8a4e3c8-90d6-493b-8747-9208c283e440" (UID: "d8a4e3c8-90d6-493b-8747-9208c283e440"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:51.314956 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.314906    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjjpm\" (UniqueName: \"kubernetes.io/projected/d8a4e3c8-90d6-493b-8747-9208c283e440-kube-api-access-sjjpm\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:02:51.315278 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.314960    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8a4e3c8-90d6-493b-8747-9208c283e440-util\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:02:51.315278 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:51.314975    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8a4e3c8-90d6-493b-8747-9208c283e440-bundle\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:02:52.044969 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:52.044929    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs"
Jul 15 20:02:52.044969 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:52.044965    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs" event={"ID":"d8a4e3c8-90d6-493b-8747-9208c283e440","Type":"ContainerDied","Data":"2a804da42047ce86d8d5b6f45688c369983957a131c9e6415b0e79597c570b29"}
Jul 15 20:02:52.045374 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:52.045007    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a804da42047ce86d8d5b6f45688c369983957a131c9e6415b0e79597c570b29"
Jul 15 20:02:58.556792 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.556759    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"]
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557060    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3103ec-7134-40a2-aae8-9532902df2e5" containerName="util"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557070    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3103ec-7134-40a2-aae8-9532902df2e5" containerName="util"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557077    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f44f3e-ec88-4fcd-9366-d4321268fb0c" containerName="extract"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557082    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f44f3e-ec88-4fcd-9366-d4321268fb0c" containerName="extract"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557093    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a4e3c8-90d6-493b-8747-9208c283e440" containerName="util"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557099    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a4e3c8-90d6-493b-8747-9208c283e440" containerName="util"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557105    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a44afb10-44b0-4a79-a632-06c1f784d07a" containerName="util"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557110    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a44afb10-44b0-4a79-a632-06c1f784d07a" containerName="util"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557115    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a44afb10-44b0-4a79-a632-06c1f784d07a" containerName="extract"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557120    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a44afb10-44b0-4a79-a632-06c1f784d07a" containerName="extract"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557126    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a44afb10-44b0-4a79-a632-06c1f784d07a" containerName="pull"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557131    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a44afb10-44b0-4a79-a632-06c1f784d07a" containerName="pull"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557139    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f44f3e-ec88-4fcd-9366-d4321268fb0c" containerName="util"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557144    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f44f3e-ec88-4fcd-9366-d4321268fb0c" containerName="util"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557150    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3103ec-7134-40a2-aae8-9532902df2e5" containerName="pull"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557155    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3103ec-7134-40a2-aae8-9532902df2e5" containerName="pull"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557160    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f44f3e-ec88-4fcd-9366-d4321268fb0c" containerName="pull"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557164    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f44f3e-ec88-4fcd-9366-d4321268fb0c" containerName="pull"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557174    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a4e3c8-90d6-493b-8747-9208c283e440" containerName="extract"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557179    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a4e3c8-90d6-493b-8747-9208c283e440" containerName="extract"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557192    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3103ec-7134-40a2-aae8-9532902df2e5" containerName="extract"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557196    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3103ec-7134-40a2-aae8-9532902df2e5" containerName="extract"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557202    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a4e3c8-90d6-493b-8747-9208c283e440" containerName="pull"
Jul 15 20:02:58.557193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557207    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a4e3c8-90d6-493b-8747-9208c283e440" containerName="pull"
Jul 15 20:02:58.557862 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557251    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a44afb10-44b0-4a79-a632-06c1f784d07a" containerName="extract"
Jul 15 20:02:58.557862 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557258    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8a4e3c8-90d6-493b-8747-9208c283e440" containerName="extract"
Jul 15 20:02:58.557862 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557264    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b3103ec-7134-40a2-aae8-9532902df2e5" containerName="extract"
Jul 15 20:02:58.557862 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.557270    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f44f3e-ec88-4fcd-9366-d4321268fb0c" containerName="extract"
Jul 15 20:02:58.559315 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.559299    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:02:58.562825 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.562802    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 20:02:58.563033 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.563019    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-44jlp\""
Jul 15 20:02:58.563101 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.563083    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 20:02:58.578431 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.578409    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"]
Jul 15 20:02:58.674504 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.674473    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7618d15-97f4-43ee-b650-11178d9a21e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jllgj\" (UID: \"c7618d15-97f4-43ee-b650-11178d9a21e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:02:58.674653 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.674524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5dzn\" (UniqueName: \"kubernetes.io/projected/c7618d15-97f4-43ee-b650-11178d9a21e6-kube-api-access-g5dzn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jllgj\" (UID: \"c7618d15-97f4-43ee-b650-11178d9a21e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:02:58.775197 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.775165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7618d15-97f4-43ee-b650-11178d9a21e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jllgj\" (UID: \"c7618d15-97f4-43ee-b650-11178d9a21e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:02:58.775350 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.775221    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5dzn\" (UniqueName: \"kubernetes.io/projected/c7618d15-97f4-43ee-b650-11178d9a21e6-kube-api-access-g5dzn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jllgj\" (UID: \"c7618d15-97f4-43ee-b650-11178d9a21e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:02:58.775537 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.775518    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7618d15-97f4-43ee-b650-11178d9a21e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jllgj\" (UID: \"c7618d15-97f4-43ee-b650-11178d9a21e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:02:58.784440 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.784416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5dzn\" (UniqueName: \"kubernetes.io/projected/c7618d15-97f4-43ee-b650-11178d9a21e6-kube-api-access-g5dzn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jllgj\" (UID: \"c7618d15-97f4-43ee-b650-11178d9a21e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:02:58.869422 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:58.869395    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:02:59.010408 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:59.010379    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"]
Jul 15 20:02:59.012607 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:02:59.012583    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7618d15_97f4_43ee_b650_11178d9a21e6.slice/crio-cdb53adc839895f7b7ee52007e0235e061ab17fe44b8ff4cbcfaef6a271443ce WatchSource:0}: Error finding container cdb53adc839895f7b7ee52007e0235e061ab17fe44b8ff4cbcfaef6a271443ce: Status 404 returned error can't find the container with id cdb53adc839895f7b7ee52007e0235e061ab17fe44b8ff4cbcfaef6a271443ce
Jul 15 20:02:59.078662 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:02:59.078637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj" event={"ID":"c7618d15-97f4-43ee-b650-11178d9a21e6","Type":"ContainerStarted","Data":"cdb53adc839895f7b7ee52007e0235e061ab17fe44b8ff4cbcfaef6a271443ce"}
Jul 15 20:03:05.753446 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:05.753423    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8"]
Jul 15 20:03:05.755652 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:05.755634    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8"
Jul 15 20:03:05.758092 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:05.758076    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 20:03:05.758209 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:05.758190    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4tnhs\""
Jul 15 20:03:05.769859 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:05.769838    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8"]
Jul 15 20:03:05.839005 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:05.838971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24js7\" (UniqueName: \"kubernetes.io/projected/df45955e-8f54-4ba2-8067-5c88de28487e-kube-api-access-24js7\") pod \"dns-operator-controller-manager-864dd78c4c-s98m8\" (UID: \"df45955e-8f54-4ba2-8067-5c88de28487e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8"
Jul 15 20:03:05.939664 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:05.939585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24js7\" (UniqueName: \"kubernetes.io/projected/df45955e-8f54-4ba2-8067-5c88de28487e-kube-api-access-24js7\") pod \"dns-operator-controller-manager-864dd78c4c-s98m8\" (UID: \"df45955e-8f54-4ba2-8067-5c88de28487e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8"
Jul 15 20:03:05.948977 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:05.948929    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24js7\" (UniqueName: \"kubernetes.io/projected/df45955e-8f54-4ba2-8067-5c88de28487e-kube-api-access-24js7\") pod \"dns-operator-controller-manager-864dd78c4c-s98m8\" (UID: \"df45955e-8f54-4ba2-8067-5c88de28487e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8"
Jul 15 20:03:06.065664 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:06.065630    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8"
Jul 15 20:03:06.121237 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:06.121199    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj" event={"ID":"c7618d15-97f4-43ee-b650-11178d9a21e6","Type":"ContainerStarted","Data":"be35ded5e69d1bb5974c2ab9744c6d7cd004f2c7c6ddc73687f25b70c0260afb"}
Jul 15 20:03:06.121818 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:06.121797    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:03:06.176443 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:06.176386    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj" podStartSLOduration=1.506239317 podStartE2EDuration="8.17636425s" totalImagesPullingTime="6.670124933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:03:06.17615413 +0000 UTC m=+523.813271422" watchObservedRunningTime="2026-07-15 20:03:06.17636425 +0000 UTC m=+523.813481541"
Jul 15 20:03:06.216891 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:06.216868    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8"]
Jul 15 20:03:06.218746 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:03:06.218723    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf45955e_8f54_4ba2_8067_5c88de28487e.slice/crio-69c91b1316836607154bcf091bf621bbd806586c22fc4273d14ca29bbe91dcb9 WatchSource:0}: Error finding container 69c91b1316836607154bcf091bf621bbd806586c22fc4273d14ca29bbe91dcb9: Status 404 returned error can't find the container with id 69c91b1316836607154bcf091bf621bbd806586c22fc4273d14ca29bbe91dcb9
Jul 15 20:03:07.127914 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:07.127882    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8" event={"ID":"df45955e-8f54-4ba2-8067-5c88de28487e","Type":"ContainerStarted","Data":"69c91b1316836607154bcf091bf621bbd806586c22fc4273d14ca29bbe91dcb9"}
Jul 15 20:03:09.139174 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:09.139135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8" event={"ID":"df45955e-8f54-4ba2-8067-5c88de28487e","Type":"ContainerStarted","Data":"3847c848fcd9c85675cbaa1ee4bc2c29e1414468978bb4c8a82725ddc6e34e60"}
Jul 15 20:03:09.139608 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:09.139214    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8"
Jul 15 20:03:09.160599 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:09.160553    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8" podStartSLOduration=1.539340879 podStartE2EDuration="4.160538428s" totalImagesPullingTime="2.621197549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:03:09.159147694 +0000 UTC m=+526.796264986" watchObservedRunningTime="2026-07-15 20:03:09.160538428 +0000 UTC m=+526.797655718"
Jul 15 20:03:18.135541 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:18.135462    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:03:20.105401 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.105372    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"]
Jul 15 20:03:20.105765 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.105549    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj" podUID="c7618d15-97f4-43ee-b650-11178d9a21e6" containerName="manager" containerID="cri-o://be35ded5e69d1bb5974c2ab9744c6d7cd004f2c7c6ddc73687f25b70c0260afb" gracePeriod=2
Jul 15 20:03:20.117210 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.117180    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"]
Jul 15 20:03:20.121068 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:03:20.121021    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c7618d15-97f4-43ee-b650-11178d9a21e6\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-jllgj\": pods \"kuadrant-operator-controller-manager-8684c9ff49-jllgj\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:03:20.131492 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.131468    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"]
Jul 15 20:03:20.131819 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.131802    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7618d15-97f4-43ee-b650-11178d9a21e6" containerName="manager"
Jul 15 20:03:20.131901 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.131823    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7618d15-97f4-43ee-b650-11178d9a21e6" containerName="manager"
Jul 15 20:03:20.131978 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.131953    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7618d15-97f4-43ee-b650-11178d9a21e6" containerName="manager"
Jul 15 20:03:20.135045 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.135025    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"
Jul 15 20:03:20.146651 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.146613    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s98m8"
Jul 15 20:03:20.150522 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.150498    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"]
Jul 15 20:03:20.173415 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:03:20.173369    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jllgj\" is forbidden: User \"system:node:ip-10-0-135-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-197.ec2.internal' and this object" podUID="c7618d15-97f4-43ee-b650-11178d9a21e6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:03:20.175367 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:03:20.175338    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jllgj\" is forbidden: User \"system:node:ip-10-0-135-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-197.ec2.internal' and this object" podUID="c7618d15-97f4-43ee-b650-11178d9a21e6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:03:20.265469 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.265439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmvhq\" (UniqueName: \"kubernetes.io/projected/52fc348e-3961-4e52-b00c-0297621a6e91-kube-api-access-vmvhq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tsb9g\" (UID: \"52fc348e-3961-4e52-b00c-0297621a6e91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"
Jul 15 20:03:20.265641 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.265483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/52fc348e-3961-4e52-b00c-0297621a6e91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tsb9g\" (UID: \"52fc348e-3961-4e52-b00c-0297621a6e91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"
Jul 15 20:03:20.354714 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.354692    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:03:20.357215 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:03:20.357171    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jllgj\" is forbidden: User \"system:node:ip-10-0-135-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-197.ec2.internal' and this object" podUID="c7618d15-97f4-43ee-b650-11178d9a21e6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:03:20.366564 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.366534    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmvhq\" (UniqueName: \"kubernetes.io/projected/52fc348e-3961-4e52-b00c-0297621a6e91-kube-api-access-vmvhq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tsb9g\" (UID: \"52fc348e-3961-4e52-b00c-0297621a6e91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"
Jul 15 20:03:20.366646 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.366575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/52fc348e-3961-4e52-b00c-0297621a6e91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tsb9g\" (UID: \"52fc348e-3961-4e52-b00c-0297621a6e91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"
Jul 15 20:03:20.366907 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.366883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/52fc348e-3961-4e52-b00c-0297621a6e91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tsb9g\" (UID: \"52fc348e-3961-4e52-b00c-0297621a6e91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"
Jul 15 20:03:20.380530 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.380500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmvhq\" (UniqueName: \"kubernetes.io/projected/52fc348e-3961-4e52-b00c-0297621a6e91-kube-api-access-vmvhq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tsb9g\" (UID: \"52fc348e-3961-4e52-b00c-0297621a6e91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"
Jul 15 20:03:20.467623 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.467594    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7618d15-97f4-43ee-b650-11178d9a21e6-extensions-socket-volume\") pod \"c7618d15-97f4-43ee-b650-11178d9a21e6\" (UID: \"c7618d15-97f4-43ee-b650-11178d9a21e6\") "
Jul 15 20:03:20.467760 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.467645    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5dzn\" (UniqueName: \"kubernetes.io/projected/c7618d15-97f4-43ee-b650-11178d9a21e6-kube-api-access-g5dzn\") pod \"c7618d15-97f4-43ee-b650-11178d9a21e6\" (UID: \"c7618d15-97f4-43ee-b650-11178d9a21e6\") "
Jul 15 20:03:20.468071 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.468048    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7618d15-97f4-43ee-b650-11178d9a21e6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c7618d15-97f4-43ee-b650-11178d9a21e6" (UID: "c7618d15-97f4-43ee-b650-11178d9a21e6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:03:20.469808 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.469788    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7618d15-97f4-43ee-b650-11178d9a21e6-kube-api-access-g5dzn" (OuterVolumeSpecName: "kube-api-access-g5dzn") pod "c7618d15-97f4-43ee-b650-11178d9a21e6" (UID: "c7618d15-97f4-43ee-b650-11178d9a21e6"). InnerVolumeSpecName "kube-api-access-g5dzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:03:20.496546 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.496517    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"
Jul 15 20:03:20.568409 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.568378    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7618d15-97f4-43ee-b650-11178d9a21e6-extensions-socket-volume\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:03:20.568409 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.568404    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5dzn\" (UniqueName: \"kubernetes.io/projected/c7618d15-97f4-43ee-b650-11178d9a21e6-kube-api-access-g5dzn\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:03:20.642799 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.642775    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"]
Jul 15 20:03:20.644625 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:03:20.644593    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52fc348e_3961_4e52_b00c_0297621a6e91.slice/crio-d767493b477fa003a8f823d75a15b93308791066dc72077ea3b9d0697252efad WatchSource:0}: Error finding container d767493b477fa003a8f823d75a15b93308791066dc72077ea3b9d0697252efad: Status 404 returned error can't find the container with id d767493b477fa003a8f823d75a15b93308791066dc72077ea3b9d0697252efad
Jul 15 20:03:20.894322 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:20.894248    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7618d15-97f4-43ee-b650-11178d9a21e6" path="/var/lib/kubelet/pods/c7618d15-97f4-43ee-b650-11178d9a21e6/volumes"
Jul 15 20:03:21.199908 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.199823    2560 generic.go:356] "Generic (PLEG): container finished" podID="c7618d15-97f4-43ee-b650-11178d9a21e6" containerID="be35ded5e69d1bb5974c2ab9744c6d7cd004f2c7c6ddc73687f25b70c0260afb" exitCode=0
Jul 15 20:03:21.199908 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.199873    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jllgj"
Jul 15 20:03:21.200388 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.199959    2560 scope.go:117] "RemoveContainer" containerID="be35ded5e69d1bb5974c2ab9744c6d7cd004f2c7c6ddc73687f25b70c0260afb"
Jul 15 20:03:21.201928 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.201901    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g" event={"ID":"52fc348e-3961-4e52-b00c-0297621a6e91","Type":"ContainerStarted","Data":"bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33"}
Jul 15 20:03:21.201928 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.201982    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g" event={"ID":"52fc348e-3961-4e52-b00c-0297621a6e91","Type":"ContainerStarted","Data":"d767493b477fa003a8f823d75a15b93308791066dc72077ea3b9d0697252efad"}
Jul 15 20:03:21.202208 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.202072    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"
Jul 15 20:03:21.208742 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.208728    2560 scope.go:117] "RemoveContainer" containerID="be35ded5e69d1bb5974c2ab9744c6d7cd004f2c7c6ddc73687f25b70c0260afb"
Jul 15 20:03:21.208997 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:03:21.208980    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be35ded5e69d1bb5974c2ab9744c6d7cd004f2c7c6ddc73687f25b70c0260afb\": container with ID starting with be35ded5e69d1bb5974c2ab9744c6d7cd004f2c7c6ddc73687f25b70c0260afb not found: ID does not exist" containerID="be35ded5e69d1bb5974c2ab9744c6d7cd004f2c7c6ddc73687f25b70c0260afb"
Jul 15 20:03:21.209054 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.209005    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be35ded5e69d1bb5974c2ab9744c6d7cd004f2c7c6ddc73687f25b70c0260afb"} err="failed to get container status \"be35ded5e69d1bb5974c2ab9744c6d7cd004f2c7c6ddc73687f25b70c0260afb\": rpc error: code = NotFound desc = could not find container \"be35ded5e69d1bb5974c2ab9744c6d7cd004f2c7c6ddc73687f25b70c0260afb\": container with ID starting with be35ded5e69d1bb5974c2ab9744c6d7cd004f2c7c6ddc73687f25b70c0260afb not found: ID does not exist"
Jul 15 20:03:21.233863 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.233820    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g" podStartSLOduration=1.233806339 podStartE2EDuration="1.233806339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:03:21.232667525 +0000 UTC m=+538.869784816" watchObservedRunningTime="2026-07-15 20:03:21.233806339 +0000 UTC m=+538.870923629"
Jul 15 20:03:21.587809 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.587733    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"]
Jul 15 20:03:21.592672 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.592652    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"
Jul 15 20:03:21.610200 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.610174    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"]
Jul 15 20:03:21.778255 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.778216    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf986f28-8e6b-4641-a91f-c3d9fd5da59f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pwrlx\" (UID: \"cf986f28-8e6b-4641-a91f-c3d9fd5da59f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"
Jul 15 20:03:21.778429 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.778260    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r5pf\" (UniqueName: \"kubernetes.io/projected/cf986f28-8e6b-4641-a91f-c3d9fd5da59f-kube-api-access-5r5pf\") pod \"kuadrant-operator-controller-manager-86878c769f-pwrlx\" (UID: \"cf986f28-8e6b-4641-a91f-c3d9fd5da59f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"
Jul 15 20:03:21.878841 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.878808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf986f28-8e6b-4641-a91f-c3d9fd5da59f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pwrlx\" (UID: \"cf986f28-8e6b-4641-a91f-c3d9fd5da59f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"
Jul 15 20:03:21.879004 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.878848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r5pf\" (UniqueName: \"kubernetes.io/projected/cf986f28-8e6b-4641-a91f-c3d9fd5da59f-kube-api-access-5r5pf\") pod \"kuadrant-operator-controller-manager-86878c769f-pwrlx\" (UID: \"cf986f28-8e6b-4641-a91f-c3d9fd5da59f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"
Jul 15 20:03:21.879223 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.879203    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf986f28-8e6b-4641-a91f-c3d9fd5da59f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pwrlx\" (UID: \"cf986f28-8e6b-4641-a91f-c3d9fd5da59f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"
Jul 15 20:03:21.895030 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.895004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r5pf\" (UniqueName: \"kubernetes.io/projected/cf986f28-8e6b-4641-a91f-c3d9fd5da59f-kube-api-access-5r5pf\") pod \"kuadrant-operator-controller-manager-86878c769f-pwrlx\" (UID: \"cf986f28-8e6b-4641-a91f-c3d9fd5da59f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"
Jul 15 20:03:21.902669 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:21.902651    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"
Jul 15 20:03:22.061334 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:22.061310    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"]
Jul 15 20:03:22.063459 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:03:22.063431    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf986f28_8e6b_4641_a91f_c3d9fd5da59f.slice/crio-e578d28ad65ed95301fc351719cbe5428e4b5ba7ec08705cba921d280d86b52a WatchSource:0}: Error finding container e578d28ad65ed95301fc351719cbe5428e4b5ba7ec08705cba921d280d86b52a: Status 404 returned error can't find the container with id e578d28ad65ed95301fc351719cbe5428e4b5ba7ec08705cba921d280d86b52a
Jul 15 20:03:22.210224 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:22.210177    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx" event={"ID":"cf986f28-8e6b-4641-a91f-c3d9fd5da59f","Type":"ContainerStarted","Data":"b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212"}
Jul 15 20:03:22.210716 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:22.210282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx" event={"ID":"cf986f28-8e6b-4641-a91f-c3d9fd5da59f","Type":"ContainerStarted","Data":"e578d28ad65ed95301fc351719cbe5428e4b5ba7ec08705cba921d280d86b52a"}
Jul 15 20:03:22.210716 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:22.210420    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"
Jul 15 20:03:22.235792 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:22.235740    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx" podStartSLOduration=1.235723001 podStartE2EDuration="1.235723001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:03:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:03:22.233613928 +0000 UTC m=+539.870731219" watchObservedRunningTime="2026-07-15 20:03:22.235723001 +0000 UTC m=+539.872840291"
Jul 15 20:03:32.212841 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:32.212811    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"
Jul 15 20:03:33.218016 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:33.217988    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"
Jul 15 20:03:33.290412 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:33.290379    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"]
Jul 15 20:03:33.290568 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:33.290543    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g" podUID="52fc348e-3961-4e52-b00c-0297621a6e91" containerName="manager" containerID="cri-o://bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33" gracePeriod=10
Jul 15 20:03:33.532846 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:33.532825    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"
Jul 15 20:03:33.575387 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:33.575362    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmvhq\" (UniqueName: \"kubernetes.io/projected/52fc348e-3961-4e52-b00c-0297621a6e91-kube-api-access-vmvhq\") pod \"52fc348e-3961-4e52-b00c-0297621a6e91\" (UID: \"52fc348e-3961-4e52-b00c-0297621a6e91\") "
Jul 15 20:03:33.575544 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:33.575401    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/52fc348e-3961-4e52-b00c-0297621a6e91-extensions-socket-volume\") pod \"52fc348e-3961-4e52-b00c-0297621a6e91\" (UID: \"52fc348e-3961-4e52-b00c-0297621a6e91\") "
Jul 15 20:03:33.578406 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:33.578339    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52fc348e-3961-4e52-b00c-0297621a6e91-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "52fc348e-3961-4e52-b00c-0297621a6e91" (UID: "52fc348e-3961-4e52-b00c-0297621a6e91"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:03:33.580076 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:33.578564    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/52fc348e-3961-4e52-b00c-0297621a6e91-extensions-socket-volume\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:03:33.581915 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:33.581882    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52fc348e-3961-4e52-b00c-0297621a6e91-kube-api-access-vmvhq" (OuterVolumeSpecName: "kube-api-access-vmvhq") pod "52fc348e-3961-4e52-b00c-0297621a6e91" (UID: "52fc348e-3961-4e52-b00c-0297621a6e91"). InnerVolumeSpecName "kube-api-access-vmvhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:03:33.679719 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:33.679690    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmvhq\" (UniqueName: \"kubernetes.io/projected/52fc348e-3961-4e52-b00c-0297621a6e91-kube-api-access-vmvhq\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:03:34.269995 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:34.269962    2560 generic.go:356] "Generic (PLEG): container finished" podID="52fc348e-3961-4e52-b00c-0297621a6e91" containerID="bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33" exitCode=0
Jul 15 20:03:34.270381 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:34.270060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g" event={"ID":"52fc348e-3961-4e52-b00c-0297621a6e91","Type":"ContainerDied","Data":"bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33"}
Jul 15 20:03:34.270381 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:34.270067    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"
Jul 15 20:03:34.270381 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:34.270100    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g" event={"ID":"52fc348e-3961-4e52-b00c-0297621a6e91","Type":"ContainerDied","Data":"d767493b477fa003a8f823d75a15b93308791066dc72077ea3b9d0697252efad"}
Jul 15 20:03:34.270381 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:34.270120    2560 scope.go:117] "RemoveContainer" containerID="bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33"
Jul 15 20:03:34.279208 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:34.279191    2560 scope.go:117] "RemoveContainer" containerID="bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33"
Jul 15 20:03:34.279445 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:03:34.279426    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33\": container with ID starting with bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33 not found: ID does not exist" containerID="bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33"
Jul 15 20:03:34.279502 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:34.279451    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33"} err="failed to get container status \"bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33\": rpc error: code = NotFound desc = could not find container \"bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33\": container with ID starting with bcacc29c1c129bb110c1b7abe6e3ce1eae05ca808874e3fbcbb997867b2c2c33 not found: ID does not exist"
Jul 15 20:03:34.292350 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:34.292319    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"]
Jul 15 20:03:34.296343 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:34.296322    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsb9g"]
Jul 15 20:03:34.894520 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:34.894490    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52fc348e-3961-4e52-b00c-0297621a6e91" path="/var/lib/kubelet/pods/52fc348e-3961-4e52-b00c-0297621a6e91/volumes"
Jul 15 20:03:51.708434 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.708401    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jbc74"]
Jul 15 20:03:51.708884 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.708726    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52fc348e-3961-4e52-b00c-0297621a6e91" containerName="manager"
Jul 15 20:03:51.708884 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.708737    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="52fc348e-3961-4e52-b00c-0297621a6e91" containerName="manager"
Jul 15 20:03:51.708884 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.708795    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="52fc348e-3961-4e52-b00c-0297621a6e91" containerName="manager"
Jul 15 20:03:51.711778 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.711759    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74"
Jul 15 20:03:51.714219 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.714194    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 20:03:51.714331 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.714202    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zhckq\""
Jul 15 20:03:51.728384 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.728357    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jbc74"]
Jul 15 20:03:51.804002 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.803971    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jbc74"]
Jul 15 20:03:51.828291 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.828265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nflzh\" (UniqueName: \"kubernetes.io/projected/b203c752-3170-4121-becb-70224730daf5-kube-api-access-nflzh\") pod \"limitador-limitador-64c94fd64f-jbc74\" (UID: \"b203c752-3170-4121-becb-70224730daf5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74"
Jul 15 20:03:51.828446 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.828304    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b203c752-3170-4121-becb-70224730daf5-config-file\") pod \"limitador-limitador-64c94fd64f-jbc74\" (UID: \"b203c752-3170-4121-becb-70224730daf5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74"
Jul 15 20:03:51.928860 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.928827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nflzh\" (UniqueName: \"kubernetes.io/projected/b203c752-3170-4121-becb-70224730daf5-kube-api-access-nflzh\") pod \"limitador-limitador-64c94fd64f-jbc74\" (UID: \"b203c752-3170-4121-becb-70224730daf5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74"
Jul 15 20:03:51.929025 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.928866    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b203c752-3170-4121-becb-70224730daf5-config-file\") pod \"limitador-limitador-64c94fd64f-jbc74\" (UID: \"b203c752-3170-4121-becb-70224730daf5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74"
Jul 15 20:03:51.929431 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.929413    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b203c752-3170-4121-becb-70224730daf5-config-file\") pod \"limitador-limitador-64c94fd64f-jbc74\" (UID: \"b203c752-3170-4121-becb-70224730daf5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74"
Jul 15 20:03:51.936672 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:51.936639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nflzh\" (UniqueName: \"kubernetes.io/projected/b203c752-3170-4121-becb-70224730daf5-kube-api-access-nflzh\") pod \"limitador-limitador-64c94fd64f-jbc74\" (UID: \"b203c752-3170-4121-becb-70224730daf5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74"
Jul 15 20:03:52.023628 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.023564    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74"
Jul 15 20:03:52.052865 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.052842    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:03:52.056386 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.056369    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"
Jul 15 20:03:52.068204 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.068184    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:03:52.112614 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.112580    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:03:52.130420 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.130394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e76dd33-ed9a-4b83-9ae9-178549d974f6-config-file\") pod \"limitador-limitador-54d6d988d5-gzwg4\" (UID: \"4e76dd33-ed9a-4b83-9ae9-178549d974f6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"
Jul 15 20:03:52.130609 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.130424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpmgq\" (UniqueName: \"kubernetes.io/projected/4e76dd33-ed9a-4b83-9ae9-178549d974f6-kube-api-access-cpmgq\") pod \"limitador-limitador-54d6d988d5-gzwg4\" (UID: \"4e76dd33-ed9a-4b83-9ae9-178549d974f6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"
Jul 15 20:03:52.170479 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.170295    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jbc74"]
Jul 15 20:03:52.173116 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:03:52.173086    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb203c752_3170_4121_becb_70224730daf5.slice/crio-d48b7959562be6741f87dd49144c06a79ddcd37fbfc2e050f7367c3b85eab858 WatchSource:0}: Error finding container d48b7959562be6741f87dd49144c06a79ddcd37fbfc2e050f7367c3b85eab858: Status 404 returned error can't find the container with id d48b7959562be6741f87dd49144c06a79ddcd37fbfc2e050f7367c3b85eab858
Jul 15 20:03:52.231387 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.231365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e76dd33-ed9a-4b83-9ae9-178549d974f6-config-file\") pod \"limitador-limitador-54d6d988d5-gzwg4\" (UID: \"4e76dd33-ed9a-4b83-9ae9-178549d974f6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"
Jul 15 20:03:52.231515 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.231395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpmgq\" (UniqueName: \"kubernetes.io/projected/4e76dd33-ed9a-4b83-9ae9-178549d974f6-kube-api-access-cpmgq\") pod \"limitador-limitador-54d6d988d5-gzwg4\" (UID: \"4e76dd33-ed9a-4b83-9ae9-178549d974f6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"
Jul 15 20:03:52.232012 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.231996    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e76dd33-ed9a-4b83-9ae9-178549d974f6-config-file\") pod \"limitador-limitador-54d6d988d5-gzwg4\" (UID: \"4e76dd33-ed9a-4b83-9ae9-178549d974f6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"
Jul 15 20:03:52.240396 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.240371    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpmgq\" (UniqueName: \"kubernetes.io/projected/4e76dd33-ed9a-4b83-9ae9-178549d974f6-kube-api-access-cpmgq\") pod \"limitador-limitador-54d6d988d5-gzwg4\" (UID: \"4e76dd33-ed9a-4b83-9ae9-178549d974f6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"
Jul 15 20:03:52.364461 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.364418    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74" event={"ID":"b203c752-3170-4121-becb-70224730daf5","Type":"ContainerStarted","Data":"d48b7959562be6741f87dd49144c06a79ddcd37fbfc2e050f7367c3b85eab858"}
Jul 15 20:03:52.367674 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.367653    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"
Jul 15 20:03:52.511538 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:52.511379    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:03:52.514018 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:03:52.513992    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e76dd33_ed9a_4b83_9ae9_178549d974f6.slice/crio-f399dba61bc9fae3276bd2ca2abac516240d6847bbae34815ba3a8aa96058258 WatchSource:0}: Error finding container f399dba61bc9fae3276bd2ca2abac516240d6847bbae34815ba3a8aa96058258: Status 404 returned error can't find the container with id f399dba61bc9fae3276bd2ca2abac516240d6847bbae34815ba3a8aa96058258
Jul 15 20:03:53.375538 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:53.375463    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4" event={"ID":"4e76dd33-ed9a-4b83-9ae9-178549d974f6","Type":"ContainerStarted","Data":"f399dba61bc9fae3276bd2ca2abac516240d6847bbae34815ba3a8aa96058258"}
Jul 15 20:03:55.388585 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:55.388556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74" event={"ID":"b203c752-3170-4121-becb-70224730daf5","Type":"ContainerStarted","Data":"15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084"}
Jul 15 20:03:55.389009 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:55.388676    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74"
Jul 15 20:03:55.390097 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:55.390078    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4" event={"ID":"4e76dd33-ed9a-4b83-9ae9-178549d974f6","Type":"ContainerStarted","Data":"d2c1ac80e74f1e259a1bd26db56a01415dbd1de975f3ecaae97b7172db502819"}
Jul 15 20:03:55.390159 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:55.390125    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"
Jul 15 20:03:55.415406 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:55.415366    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74" podStartSLOduration=1.301063617 podStartE2EDuration="4.4153542s" totalImagesPullingTime="3.114290583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:03:55.41308046 +0000 UTC m=+573.050197749" watchObservedRunningTime="2026-07-15 20:03:55.4153542 +0000 UTC m=+573.052471489"
Jul 15 20:03:55.444696 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:03:55.444655    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4" podStartSLOduration=0.672983735 podStartE2EDuration="3.444644031s" totalImagesPullingTime="2.771660296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:03:55.4435519 +0000 UTC m=+573.080669190" watchObservedRunningTime="2026-07-15 20:03:55.444644031 +0000 UTC m=+573.081761322"
Jul 15 20:04:06.396427 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:06.396393    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74"
Jul 15 20:04:06.396780 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:06.396460    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"
Jul 15 20:04:06.481000 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:06.480959    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jbc74"]
Jul 15 20:04:06.481185 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:06.481134    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74" podUID="b203c752-3170-4121-becb-70224730daf5" containerName="limitador" containerID="cri-o://15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084" gracePeriod=30
Jul 15 20:04:07.032530 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.032504    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74"
Jul 15 20:04:07.169393 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.169365    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nflzh\" (UniqueName: \"kubernetes.io/projected/b203c752-3170-4121-becb-70224730daf5-kube-api-access-nflzh\") pod \"b203c752-3170-4121-becb-70224730daf5\" (UID: \"b203c752-3170-4121-becb-70224730daf5\") "
Jul 15 20:04:07.169548 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.169411    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b203c752-3170-4121-becb-70224730daf5-config-file\") pod \"b203c752-3170-4121-becb-70224730daf5\" (UID: \"b203c752-3170-4121-becb-70224730daf5\") "
Jul 15 20:04:07.169783 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.169762    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b203c752-3170-4121-becb-70224730daf5-config-file" (OuterVolumeSpecName: "config-file") pod "b203c752-3170-4121-becb-70224730daf5" (UID: "b203c752-3170-4121-becb-70224730daf5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:04:07.171597 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.171577    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b203c752-3170-4121-becb-70224730daf5-kube-api-access-nflzh" (OuterVolumeSpecName: "kube-api-access-nflzh") pod "b203c752-3170-4121-becb-70224730daf5" (UID: "b203c752-3170-4121-becb-70224730daf5"). InnerVolumeSpecName "kube-api-access-nflzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:04:07.270292 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.270265    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nflzh\" (UniqueName: \"kubernetes.io/projected/b203c752-3170-4121-becb-70224730daf5-kube-api-access-nflzh\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:04:07.270292 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.270288    2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b203c752-3170-4121-becb-70224730daf5-config-file\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:04:07.452388 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.452310    2560 generic.go:356] "Generic (PLEG): container finished" podID="b203c752-3170-4121-becb-70224730daf5" containerID="15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084" exitCode=0
Jul 15 20:04:07.452388 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.452351    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74"
Jul 15 20:04:07.452388 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.452380    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74" event={"ID":"b203c752-3170-4121-becb-70224730daf5","Type":"ContainerDied","Data":"15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084"}
Jul 15 20:04:07.452839 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.452420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jbc74" event={"ID":"b203c752-3170-4121-becb-70224730daf5","Type":"ContainerDied","Data":"d48b7959562be6741f87dd49144c06a79ddcd37fbfc2e050f7367c3b85eab858"}
Jul 15 20:04:07.452839 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.452440    2560 scope.go:117] "RemoveContainer" containerID="15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084"
Jul 15 20:04:07.461608 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.461591    2560 scope.go:117] "RemoveContainer" containerID="15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084"
Jul 15 20:04:07.461878 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:04:07.461861    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084\": container with ID starting with 15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084 not found: ID does not exist" containerID="15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084"
Jul 15 20:04:07.461969 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.461890    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084"} err="failed to get container status \"15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084\": rpc error: code = NotFound desc = could not find container \"15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084\": container with ID starting with 15acf0e0d0d2dd68d8cd9618a6cc9be595c434bba9e92c37ae4c6033ee066084 not found: ID does not exist"
Jul 15 20:04:07.475546 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.475523    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jbc74"]
Jul 15 20:04:07.485673 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:07.485656    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jbc74"]
Jul 15 20:04:08.297241 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.297209    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"]
Jul 15 20:04:08.297575 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.297562    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b203c752-3170-4121-becb-70224730daf5" containerName="limitador"
Jul 15 20:04:08.297617 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.297576    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b203c752-3170-4121-becb-70224730daf5" containerName="limitador"
Jul 15 20:04:08.297650 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.297644    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b203c752-3170-4121-becb-70224730daf5" containerName="limitador"
Jul 15 20:04:08.301830 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.301809    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"
Jul 15 20:04:08.304604 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.304583    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rx7vn\""
Jul 15 20:04:08.304750 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.304619    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 20:04:08.305387 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.305369    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 20:04:08.305475 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.305405    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 20:04:08.315596 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.315577    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"]
Jul 15 20:04:08.478825 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.478800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvsf4\" (UniqueName: \"kubernetes.io/projected/3fd4d8a3-940b-46d2-92a6-89c7792d99b1-kube-api-access-rvsf4\") pod \"postgres-69fb4594cf-dsmqp\" (UID: \"3fd4d8a3-940b-46d2-92a6-89c7792d99b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"
Jul 15 20:04:08.479223 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.478834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3fd4d8a3-940b-46d2-92a6-89c7792d99b1-data\") pod \"postgres-69fb4594cf-dsmqp\" (UID: \"3fd4d8a3-940b-46d2-92a6-89c7792d99b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"
Jul 15 20:04:08.579778 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.579708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvsf4\" (UniqueName: \"kubernetes.io/projected/3fd4d8a3-940b-46d2-92a6-89c7792d99b1-kube-api-access-rvsf4\") pod \"postgres-69fb4594cf-dsmqp\" (UID: \"3fd4d8a3-940b-46d2-92a6-89c7792d99b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"
Jul 15 20:04:08.579778 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.579741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3fd4d8a3-940b-46d2-92a6-89c7792d99b1-data\") pod \"postgres-69fb4594cf-dsmqp\" (UID: \"3fd4d8a3-940b-46d2-92a6-89c7792d99b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"
Jul 15 20:04:08.580133 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.580117    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3fd4d8a3-940b-46d2-92a6-89c7792d99b1-data\") pod \"postgres-69fb4594cf-dsmqp\" (UID: \"3fd4d8a3-940b-46d2-92a6-89c7792d99b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"
Jul 15 20:04:08.590420 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.590394    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvsf4\" (UniqueName: \"kubernetes.io/projected/3fd4d8a3-940b-46d2-92a6-89c7792d99b1-kube-api-access-rvsf4\") pod \"postgres-69fb4594cf-dsmqp\" (UID: \"3fd4d8a3-940b-46d2-92a6-89c7792d99b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"
Jul 15 20:04:08.612419 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.612397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"
Jul 15 20:04:08.748797 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.748771    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"]
Jul 15 20:04:08.750552 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:04:08.750525    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd4d8a3_940b_46d2_92a6_89c7792d99b1.slice/crio-a844f42f00274a932fb145cf589472125b67c8bb922f7ac3c0e1b6169f9fdfe2 WatchSource:0}: Error finding container a844f42f00274a932fb145cf589472125b67c8bb922f7ac3c0e1b6169f9fdfe2: Status 404 returned error can't find the container with id a844f42f00274a932fb145cf589472125b67c8bb922f7ac3c0e1b6169f9fdfe2
Jul 15 20:04:08.894562 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:08.894525    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b203c752-3170-4121-becb-70224730daf5" path="/var/lib/kubelet/pods/b203c752-3170-4121-becb-70224730daf5/volumes"
Jul 15 20:04:09.468839 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:09.468760    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp" event={"ID":"3fd4d8a3-940b-46d2-92a6-89c7792d99b1","Type":"ContainerStarted","Data":"a844f42f00274a932fb145cf589472125b67c8bb922f7ac3c0e1b6169f9fdfe2"}
Jul 15 20:04:13.491098 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:13.491063    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp" event={"ID":"3fd4d8a3-940b-46d2-92a6-89c7792d99b1","Type":"ContainerStarted","Data":"99ddd06162bfa4b2124cd29b8d6fe9666d873d5419f3a1319fbffb56b4c85860"}
Jul 15 20:04:13.491530 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:13.491199    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"
Jul 15 20:04:13.514774 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:13.514715    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp" podStartSLOduration=0.972444156 podStartE2EDuration="5.51469349s" totalImagesPullingTime="4.542249334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:04:13.51223394 +0000 UTC m=+591.149351231" watchObservedRunningTime="2026-07-15 20:04:13.51469349 +0000 UTC m=+591.151810782"
Jul 15 20:04:19.527237 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:19.527210    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dsmqp"
Jul 15 20:04:22.752269 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:22.752243    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:04:22.752965 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:22.752922    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:04:26.552220 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:26.552188    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f9b775cb-nq7wq"]
Jul 15 20:04:26.707173 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:26.707137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f9b775cb-nq7wq"]
Jul 15 20:04:26.707328 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:26.707227    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f9b775cb-nq7wq"
Jul 15 20:04:26.710686 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:26.710660    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 20:04:26.710822 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:26.710661    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 20:04:26.710822 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:26.710661    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8qvkx\""
Jul 15 20:04:26.831293 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:26.831218    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76964212-fb83-410d-8810-a45612fe069e-webhook-cert\") pod \"maas-controller-7f9b775cb-nq7wq\" (UID: \"76964212-fb83-410d-8810-a45612fe069e\") " pod="opendatahub/maas-controller-7f9b775cb-nq7wq"
Jul 15 20:04:26.831293 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:26.831250    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4xdb\" (UniqueName: \"kubernetes.io/projected/76964212-fb83-410d-8810-a45612fe069e-kube-api-access-g4xdb\") pod \"maas-controller-7f9b775cb-nq7wq\" (UID: \"76964212-fb83-410d-8810-a45612fe069e\") " pod="opendatahub/maas-controller-7f9b775cb-nq7wq"
Jul 15 20:04:26.932007 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:26.931971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76964212-fb83-410d-8810-a45612fe069e-webhook-cert\") pod \"maas-controller-7f9b775cb-nq7wq\" (UID: \"76964212-fb83-410d-8810-a45612fe069e\") " pod="opendatahub/maas-controller-7f9b775cb-nq7wq"
Jul 15 20:04:26.932175 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:26.932015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4xdb\" (UniqueName: \"kubernetes.io/projected/76964212-fb83-410d-8810-a45612fe069e-kube-api-access-g4xdb\") pod \"maas-controller-7f9b775cb-nq7wq\" (UID: \"76964212-fb83-410d-8810-a45612fe069e\") " pod="opendatahub/maas-controller-7f9b775cb-nq7wq"
Jul 15 20:04:26.934606 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:26.934581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76964212-fb83-410d-8810-a45612fe069e-webhook-cert\") pod \"maas-controller-7f9b775cb-nq7wq\" (UID: \"76964212-fb83-410d-8810-a45612fe069e\") " pod="opendatahub/maas-controller-7f9b775cb-nq7wq"
Jul 15 20:04:26.941791 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:26.941766    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4xdb\" (UniqueName: \"kubernetes.io/projected/76964212-fb83-410d-8810-a45612fe069e-kube-api-access-g4xdb\") pod \"maas-controller-7f9b775cb-nq7wq\" (UID: \"76964212-fb83-410d-8810-a45612fe069e\") " pod="opendatahub/maas-controller-7f9b775cb-nq7wq"
Jul 15 20:04:27.017700 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:27.017668    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f9b775cb-nq7wq"
Jul 15 20:04:27.175849 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:27.175815    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f9b775cb-nq7wq"]
Jul 15 20:04:27.178991 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:04:27.178963    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76964212_fb83_410d_8810_a45612fe069e.slice/crio-1ade189a1799829b41be9c8bc9cd50db815685ba797a180ac034d949eb637c14 WatchSource:0}: Error finding container 1ade189a1799829b41be9c8bc9cd50db815685ba797a180ac034d949eb637c14: Status 404 returned error can't find the container with id 1ade189a1799829b41be9c8bc9cd50db815685ba797a180ac034d949eb637c14
Jul 15 20:04:27.561922 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:27.561887    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f9b775cb-nq7wq" event={"ID":"76964212-fb83-410d-8810-a45612fe069e","Type":"ContainerStarted","Data":"1ade189a1799829b41be9c8bc9cd50db815685ba797a180ac034d949eb637c14"}
Jul 15 20:04:30.582101 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:30.582062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f9b775cb-nq7wq" event={"ID":"76964212-fb83-410d-8810-a45612fe069e","Type":"ContainerStarted","Data":"84b9cf358bc868537ba141827b5445a289072d20b243d858df99792c2341388c"}
Jul 15 20:04:30.582470 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:30.582198    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f9b775cb-nq7wq"
Jul 15 20:04:30.614698 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:30.614643    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f9b775cb-nq7wq" podStartSLOduration=2.116399983 podStartE2EDuration="4.614628547s" totalImagesPullingTime="2.498228564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:04:30.61273614 +0000 UTC m=+608.249853431" watchObservedRunningTime="2026-07-15 20:04:30.614628547 +0000 UTC m=+608.251745837"
Jul 15 20:04:41.590301 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:04:41.590269    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f9b775cb-nq7wq"
Jul 15 20:05:02.265021 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.264984    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"]
Jul 15 20:05:02.272392 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.272367    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:02.275626 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.275596    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zt9px\""
Jul 15 20:05:02.275753 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.275648    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 20:05:02.332302 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.332261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm8c5\" (UniqueName: \"kubernetes.io/projected/70b5f106-2e47-48c4-a6c4-e5a801a4ee29-kube-api-access-gm8c5\") pod \"maas-api-9b9d495d8-fzf5d\" (UID: \"70b5f106-2e47-48c4-a6c4-e5a801a4ee29\") " pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:02.332457 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.332326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70b5f106-2e47-48c4-a6c4-e5a801a4ee29-openshift-service-ca\") pod \"maas-api-9b9d495d8-fzf5d\" (UID: \"70b5f106-2e47-48c4-a6c4-e5a801a4ee29\") " pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:02.332457 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.332359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70b5f106-2e47-48c4-a6c4-e5a801a4ee29-maas-api-tls\") pod \"maas-api-9b9d495d8-fzf5d\" (UID: \"70b5f106-2e47-48c4-a6c4-e5a801a4ee29\") " pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:02.338117 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.338092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"]
Jul 15 20:05:02.433394 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.433360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm8c5\" (UniqueName: \"kubernetes.io/projected/70b5f106-2e47-48c4-a6c4-e5a801a4ee29-kube-api-access-gm8c5\") pod \"maas-api-9b9d495d8-fzf5d\" (UID: \"70b5f106-2e47-48c4-a6c4-e5a801a4ee29\") " pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:02.433548 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.433405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70b5f106-2e47-48c4-a6c4-e5a801a4ee29-openshift-service-ca\") pod \"maas-api-9b9d495d8-fzf5d\" (UID: \"70b5f106-2e47-48c4-a6c4-e5a801a4ee29\") " pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:02.433548 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.433425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70b5f106-2e47-48c4-a6c4-e5a801a4ee29-maas-api-tls\") pod \"maas-api-9b9d495d8-fzf5d\" (UID: \"70b5f106-2e47-48c4-a6c4-e5a801a4ee29\") " pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:02.433548 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:05:02.433543    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 15 20:05:02.433647 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:05:02.433610    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70b5f106-2e47-48c4-a6c4-e5a801a4ee29-maas-api-tls podName:70b5f106-2e47-48c4-a6c4-e5a801a4ee29 nodeName:}" failed. No retries permitted until 2026-07-15 20:05:02.933590789 +0000 UTC m=+640.570708060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/70b5f106-2e47-48c4-a6c4-e5a801a4ee29-maas-api-tls") pod "maas-api-9b9d495d8-fzf5d" (UID: "70b5f106-2e47-48c4-a6c4-e5a801a4ee29") : secret "maas-api-serving-cert" not found
Jul 15 20:05:02.434100 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.434081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70b5f106-2e47-48c4-a6c4-e5a801a4ee29-openshift-service-ca\") pod \"maas-api-9b9d495d8-fzf5d\" (UID: \"70b5f106-2e47-48c4-a6c4-e5a801a4ee29\") " pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:02.461176 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.461144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm8c5\" (UniqueName: \"kubernetes.io/projected/70b5f106-2e47-48c4-a6c4-e5a801a4ee29-kube-api-access-gm8c5\") pod \"maas-api-9b9d495d8-fzf5d\" (UID: \"70b5f106-2e47-48c4-a6c4-e5a801a4ee29\") " pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:02.936508 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.936476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70b5f106-2e47-48c4-a6c4-e5a801a4ee29-maas-api-tls\") pod \"maas-api-9b9d495d8-fzf5d\" (UID: \"70b5f106-2e47-48c4-a6c4-e5a801a4ee29\") " pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:02.938896 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:02.938879    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70b5f106-2e47-48c4-a6c4-e5a801a4ee29-maas-api-tls\") pod \"maas-api-9b9d495d8-fzf5d\" (UID: \"70b5f106-2e47-48c4-a6c4-e5a801a4ee29\") " pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:03.186506 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:03.186462    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:03.209294 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:03.209256    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:05:03.332682 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:03.332516    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"]
Jul 15 20:05:03.335534 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:05:03.335509    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b5f106_2e47_48c4_a6c4_e5a801a4ee29.slice/crio-f715a418d013ae74741866ed76a6896e1a04aa1262e87c7cda85ae501c949c46 WatchSource:0}: Error finding container f715a418d013ae74741866ed76a6896e1a04aa1262e87c7cda85ae501c949c46: Status 404 returned error can't find the container with id f715a418d013ae74741866ed76a6896e1a04aa1262e87c7cda85ae501c949c46
Jul 15 20:05:03.336791 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:03.336772    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 20:05:03.752668 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:03.752626    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d" event={"ID":"70b5f106-2e47-48c4-a6c4-e5a801a4ee29","Type":"ContainerStarted","Data":"f715a418d013ae74741866ed76a6896e1a04aa1262e87c7cda85ae501c949c46"}
Jul 15 20:05:05.768315 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:05.768276    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d" event={"ID":"70b5f106-2e47-48c4-a6c4-e5a801a4ee29","Type":"ContainerStarted","Data":"2791e1e08ee51d89c4d6ce6d125c798490bfd554e206183238501268bdc0a7b4"}
Jul 15 20:05:05.768792 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:05.768405    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:05.798519 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:05.798473    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d" podStartSLOduration=2.243381512 podStartE2EDuration="3.798457183s" totalImagesPullingTime="1.555075671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:05:05.791570416 +0000 UTC m=+643.428687706" watchObservedRunningTime="2026-07-15 20:05:05.798457183 +0000 UTC m=+643.435574525"
Jul 15 20:05:11.778555 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:11.778524    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-9b9d495d8-fzf5d"
Jul 15 20:05:31.077133 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:31.077101    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:05:42.956131 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:42.956098    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"]
Jul 15 20:05:42.959689 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:42.959665    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:42.962396 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:42.962376    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9fcf5\""
Jul 15 20:05:42.963171 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:42.963156    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 20:05:42.963230 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:42.963156    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 20:05:42.963279 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:42.963257    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 15 20:05:42.973814 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:42.973792    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"]
Jul 15 20:05:43.001041 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.001017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.001154 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.001056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99kcn\" (UniqueName: \"kubernetes.io/projected/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-kube-api-access-99kcn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.001154 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.001089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.001154 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.001126    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.001256 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.001157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.001256 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.001209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.101771 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.101734    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.101922 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.101809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.101922 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.101852    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99kcn\" (UniqueName: \"kubernetes.io/projected/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-kube-api-access-99kcn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.101922 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.101907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.102092 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.101929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.102092 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.101987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.102251 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.102177    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.102325 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.102284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.102366 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.102342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.104489 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.104439    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.104697 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.104680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.110151 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.110133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99kcn\" (UniqueName: \"kubernetes.io/projected/fdb4fbe9-d871-46d6-aa76-7a17cd6da09b-kube-api-access-99kcn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9v49\" (UID: \"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.270176 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.270098    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:43.408648 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.408622    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"]
Jul 15 20:05:43.410548 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:05:43.410512    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb4fbe9_d871_46d6_aa76_7a17cd6da09b.slice/crio-9e8d0fd3794233803eb786bbe6999ab3f12e1405170d6b747e9b2fc6f4e86fae WatchSource:0}: Error finding container 9e8d0fd3794233803eb786bbe6999ab3f12e1405170d6b747e9b2fc6f4e86fae: Status 404 returned error can't find the container with id 9e8d0fd3794233803eb786bbe6999ab3f12e1405170d6b747e9b2fc6f4e86fae
Jul 15 20:05:43.876801 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.876527    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:05:43.961058 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:43.961017    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49" event={"ID":"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b","Type":"ContainerStarted","Data":"9e8d0fd3794233803eb786bbe6999ab3f12e1405170d6b747e9b2fc6f4e86fae"}
Jul 15 20:05:44.967606 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:44.967571    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49" event={"ID":"fdb4fbe9-d871-46d6-aa76-7a17cd6da09b","Type":"ContainerStarted","Data":"14238414e1915ec270312b32ebc837f581feb18f5904a018ed5a524c5aece8f9"}
Jul 15 20:05:44.992054 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:44.992007    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49" podStartSLOduration=1.985975325 podStartE2EDuration="2.991992523s" totalImagesPullingTime="1.006017198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:05:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:05:44.99013263 +0000 UTC m=+682.627249920" watchObservedRunningTime="2026-07-15 20:05:44.991992523 +0000 UTC m=+682.629109813"
Jul 15 20:05:52.477124 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:52.477087    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:05:53.270764 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:53.270730    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:53.270924 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:53.270790    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:53.283537 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:53.283505    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:05:54.023569 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:05:54.023542    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9v49"
Jul 15 20:06:06.671041 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:06.671004    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:06:12.269067 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.269036    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"]
Jul 15 20:06:12.274912 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.274895    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.277506 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.277483    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 20:06:12.283215 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.283197    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"]
Jul 15 20:06:12.368269 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.368227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a9a0313-1c2a-4b49-b838-9769ad0438f7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.368441 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.368315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a9a0313-1c2a-4b49-b838-9769ad0438f7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.368441 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.368383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a9a0313-1c2a-4b49-b838-9769ad0438f7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.368527 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.368456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a9a0313-1c2a-4b49-b838-9769ad0438f7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.368527 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.368504    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a9a0313-1c2a-4b49-b838-9769ad0438f7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.368527 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.368524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9cpl\" (UniqueName: \"kubernetes.io/projected/9a9a0313-1c2a-4b49-b838-9769ad0438f7-kube-api-access-h9cpl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.469159 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.469123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a9a0313-1c2a-4b49-b838-9769ad0438f7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.469159 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.469163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a9a0313-1c2a-4b49-b838-9769ad0438f7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.469356 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.469182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9cpl\" (UniqueName: \"kubernetes.io/projected/9a9a0313-1c2a-4b49-b838-9769ad0438f7-kube-api-access-h9cpl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.469356 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.469227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a9a0313-1c2a-4b49-b838-9769ad0438f7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.469356 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.469253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a9a0313-1c2a-4b49-b838-9769ad0438f7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.469504 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.469433    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a9a0313-1c2a-4b49-b838-9769ad0438f7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.469610 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.469585    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a9a0313-1c2a-4b49-b838-9769ad0438f7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.469746 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.469621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a9a0313-1c2a-4b49-b838-9769ad0438f7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.469746 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.469740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a9a0313-1c2a-4b49-b838-9769ad0438f7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.471592 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.471563    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a9a0313-1c2a-4b49-b838-9769ad0438f7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.471826 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.471810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a9a0313-1c2a-4b49-b838-9769ad0438f7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.479405 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.479387    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9cpl\" (UniqueName: \"kubernetes.io/projected/9a9a0313-1c2a-4b49-b838-9769ad0438f7-kube-api-access-h9cpl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4n8tk\" (UID: \"9a9a0313-1c2a-4b49-b838-9769ad0438f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.586097 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.586009    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:12.727726 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:12.727700    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"]
Jul 15 20:06:12.729402 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:06:12.729368    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9a0313_1c2a_4b49_b838_9769ad0438f7.slice/crio-b4a5d78f3910f926b2331ab25caa0b4d014145af7bda0f271142e412183d009a WatchSource:0}: Error finding container b4a5d78f3910f926b2331ab25caa0b4d014145af7bda0f271142e412183d009a: Status 404 returned error can't find the container with id b4a5d78f3910f926b2331ab25caa0b4d014145af7bda0f271142e412183d009a
Jul 15 20:06:13.109693 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:13.109662    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk" event={"ID":"9a9a0313-1c2a-4b49-b838-9769ad0438f7","Type":"ContainerStarted","Data":"c2f8e0ef74b5f1019d3c6529e53d45a62208a810c716d5bbd3a8e2aaab8cac3b"}
Jul 15 20:06:13.109859 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:13.109712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk" event={"ID":"9a9a0313-1c2a-4b49-b838-9769ad0438f7","Type":"ContainerStarted","Data":"b4a5d78f3910f926b2331ab25caa0b4d014145af7bda0f271142e412183d009a"}
Jul 15 20:06:13.131758 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:13.131705    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk" podStartSLOduration=0.927640901 podStartE2EDuration="1.131688284s" totalImagesPullingTime="204.047383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:06:13.130109163 +0000 UTC m=+710.767226450" watchObservedRunningTime="2026-07-15 20:06:13.131688284 +0000 UTC m=+710.768805573"
Jul 15 20:06:14.375619 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:14.375588    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:06:22.586797 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:22.586750    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:22.587228 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:22.586848    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:22.599712 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:22.599689    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:23.172616 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:23.172589    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4n8tk"
Jul 15 20:06:25.664956 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:06:25.664912    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:07:42.368999 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:07:42.368962    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:07:52.774219 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:07:52.774184    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:08:02.771283 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:02.771251    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:08:13.074116 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:13.074087    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:08:22.272507 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:22.272470    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:08:25.605093 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:25.605057    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f9b775cb-nq7wq"]
Jul 15 20:08:25.605621 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:25.605293    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f9b775cb-nq7wq" podUID="76964212-fb83-410d-8810-a45612fe069e" containerName="manager" containerID="cri-o://84b9cf358bc868537ba141827b5445a289072d20b243d858df99792c2341388c" gracePeriod=30
Jul 15 20:08:25.801716 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:25.801682    2560 generic.go:356] "Generic (PLEG): container finished" podID="76964212-fb83-410d-8810-a45612fe069e" containerID="84b9cf358bc868537ba141827b5445a289072d20b243d858df99792c2341388c" exitCode=0
Jul 15 20:08:25.801865 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:25.801748    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f9b775cb-nq7wq" event={"ID":"76964212-fb83-410d-8810-a45612fe069e","Type":"ContainerDied","Data":"84b9cf358bc868537ba141827b5445a289072d20b243d858df99792c2341388c"}
Jul 15 20:08:25.872144 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:25.872123    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f9b775cb-nq7wq"
Jul 15 20:08:25.910814 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:25.910781    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76964212-fb83-410d-8810-a45612fe069e-webhook-cert\") pod \"76964212-fb83-410d-8810-a45612fe069e\" (UID: \"76964212-fb83-410d-8810-a45612fe069e\") "
Jul 15 20:08:25.911020 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:25.910865    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4xdb\" (UniqueName: \"kubernetes.io/projected/76964212-fb83-410d-8810-a45612fe069e-kube-api-access-g4xdb\") pod \"76964212-fb83-410d-8810-a45612fe069e\" (UID: \"76964212-fb83-410d-8810-a45612fe069e\") "
Jul 15 20:08:25.913259 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:25.913224    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76964212-fb83-410d-8810-a45612fe069e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "76964212-fb83-410d-8810-a45612fe069e" (UID: "76964212-fb83-410d-8810-a45612fe069e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:08:25.913399 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:25.913337    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76964212-fb83-410d-8810-a45612fe069e-kube-api-access-g4xdb" (OuterVolumeSpecName: "kube-api-access-g4xdb") pod "76964212-fb83-410d-8810-a45612fe069e" (UID: "76964212-fb83-410d-8810-a45612fe069e"). InnerVolumeSpecName "kube-api-access-g4xdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:08:26.011812 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:26.011774    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76964212-fb83-410d-8810-a45612fe069e-webhook-cert\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:08:26.011812 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:26.011808    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4xdb\" (UniqueName: \"kubernetes.io/projected/76964212-fb83-410d-8810-a45612fe069e-kube-api-access-g4xdb\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:08:26.807840 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:26.807803    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f9b775cb-nq7wq"
Jul 15 20:08:26.808268 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:26.807804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f9b775cb-nq7wq" event={"ID":"76964212-fb83-410d-8810-a45612fe069e","Type":"ContainerDied","Data":"1ade189a1799829b41be9c8bc9cd50db815685ba797a180ac034d949eb637c14"}
Jul 15 20:08:26.808268 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:26.807977    2560 scope.go:117] "RemoveContainer" containerID="84b9cf358bc868537ba141827b5445a289072d20b243d858df99792c2341388c"
Jul 15 20:08:26.828602 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:26.828575    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f9b775cb-nq7wq"]
Jul 15 20:08:26.833158 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:26.833135    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f9b775cb-nq7wq"]
Jul 15 20:08:26.894988 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:26.894929    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76964212-fb83-410d-8810-a45612fe069e" path="/var/lib/kubelet/pods/76964212-fb83-410d-8810-a45612fe069e/volumes"
Jul 15 20:08:27.600125 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.600083    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f9b775cb-sps88"]
Jul 15 20:08:27.600502 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.600485    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76964212-fb83-410d-8810-a45612fe069e" containerName="manager"
Jul 15 20:08:27.600580 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.600505    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="76964212-fb83-410d-8810-a45612fe069e" containerName="manager"
Jul 15 20:08:27.600639 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.600621    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="76964212-fb83-410d-8810-a45612fe069e" containerName="manager"
Jul 15 20:08:27.605067 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.605048    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f9b775cb-sps88"
Jul 15 20:08:27.608695 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.608675    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 20:08:27.608807 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.608774    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 20:08:27.608895 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.608880    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8qvkx\""
Jul 15 20:08:27.612219 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.612194    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f9b775cb-sps88"]
Jul 15 20:08:27.626752 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.626716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d835bab-d54f-477c-a659-8a47716e7fe9-webhook-cert\") pod \"maas-controller-7f9b775cb-sps88\" (UID: \"1d835bab-d54f-477c-a659-8a47716e7fe9\") " pod="opendatahub/maas-controller-7f9b775cb-sps88"
Jul 15 20:08:27.626877 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.626766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6sq6\" (UniqueName: \"kubernetes.io/projected/1d835bab-d54f-477c-a659-8a47716e7fe9-kube-api-access-n6sq6\") pod \"maas-controller-7f9b775cb-sps88\" (UID: \"1d835bab-d54f-477c-a659-8a47716e7fe9\") " pod="opendatahub/maas-controller-7f9b775cb-sps88"
Jul 15 20:08:27.727540 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.727494    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d835bab-d54f-477c-a659-8a47716e7fe9-webhook-cert\") pod \"maas-controller-7f9b775cb-sps88\" (UID: \"1d835bab-d54f-477c-a659-8a47716e7fe9\") " pod="opendatahub/maas-controller-7f9b775cb-sps88"
Jul 15 20:08:27.727739 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.727572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6sq6\" (UniqueName: \"kubernetes.io/projected/1d835bab-d54f-477c-a659-8a47716e7fe9-kube-api-access-n6sq6\") pod \"maas-controller-7f9b775cb-sps88\" (UID: \"1d835bab-d54f-477c-a659-8a47716e7fe9\") " pod="opendatahub/maas-controller-7f9b775cb-sps88"
Jul 15 20:08:27.730256 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.730236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d835bab-d54f-477c-a659-8a47716e7fe9-webhook-cert\") pod \"maas-controller-7f9b775cb-sps88\" (UID: \"1d835bab-d54f-477c-a659-8a47716e7fe9\") " pod="opendatahub/maas-controller-7f9b775cb-sps88"
Jul 15 20:08:27.736849 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.736823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6sq6\" (UniqueName: \"kubernetes.io/projected/1d835bab-d54f-477c-a659-8a47716e7fe9-kube-api-access-n6sq6\") pod \"maas-controller-7f9b775cb-sps88\" (UID: \"1d835bab-d54f-477c-a659-8a47716e7fe9\") " pod="opendatahub/maas-controller-7f9b775cb-sps88"
Jul 15 20:08:27.916077 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:27.915971    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f9b775cb-sps88"
Jul 15 20:08:28.055827 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:28.055802    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f9b775cb-sps88"]
Jul 15 20:08:28.058253 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:08:28.058215    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d835bab_d54f_477c_a659_8a47716e7fe9.slice/crio-557de52442b16e874e08fdc31a738d10160f67377ab52f15ce75def8eae89319 WatchSource:0}: Error finding container 557de52442b16e874e08fdc31a738d10160f67377ab52f15ce75def8eae89319: Status 404 returned error can't find the container with id 557de52442b16e874e08fdc31a738d10160f67377ab52f15ce75def8eae89319
Jul 15 20:08:28.820659 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:28.820622    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f9b775cb-sps88" event={"ID":"1d835bab-d54f-477c-a659-8a47716e7fe9","Type":"ContainerStarted","Data":"557de52442b16e874e08fdc31a738d10160f67377ab52f15ce75def8eae89319"}
Jul 15 20:08:29.827150 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:29.827107    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f9b775cb-sps88" event={"ID":"1d835bab-d54f-477c-a659-8a47716e7fe9","Type":"ContainerStarted","Data":"c881dc47936912daf9604c4abf6fe61ee2c9712c267e84f07aefeeaf1cfc4450"}
Jul 15 20:08:29.827602 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:29.827208    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f9b775cb-sps88"
Jul 15 20:08:29.849815 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:29.849764    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f9b775cb-sps88" podStartSLOduration=1.92573528 podStartE2EDuration="2.849750051s" totalImagesPullingTime="924.014771ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:08:29.847303343 +0000 UTC m=+847.484420645" watchObservedRunningTime="2026-07-15 20:08:29.849750051 +0000 UTC m=+847.486867341"
Jul 15 20:08:40.796572 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:40.796538    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-769f77b954-qpszl"]
Jul 15 20:08:40.834196 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:40.834170    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f9b775cb-sps88"
Jul 15 20:08:51.372494 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:08:51.372462    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:09:02.585977 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:02.585873    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:09:05.817220 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:05.817183    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-769f77b954-qpszl" podUID="e3092602-9d5c-4442-8341-f29a69cb7c56" containerName="console" containerID="cri-o://989c4350563bd4948b41137c3295261482bbbf87a9355ccbe235be25326ac7c4" gracePeriod=15
Jul 15 20:09:06.019999 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.019969    2560 generic.go:356] "Generic (PLEG): container finished" podID="e3092602-9d5c-4442-8341-f29a69cb7c56" containerID="989c4350563bd4948b41137c3295261482bbbf87a9355ccbe235be25326ac7c4" exitCode=0
Jul 15 20:09:06.020195 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.020051    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769f77b954-qpszl" event={"ID":"e3092602-9d5c-4442-8341-f29a69cb7c56","Type":"ContainerDied","Data":"989c4350563bd4948b41137c3295261482bbbf87a9355ccbe235be25326ac7c4"}
Jul 15 20:09:06.070473 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.070416    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769f77b954-qpszl"
Jul 15 20:09:06.075744 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.075722    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-trusted-ca-bundle\") pod \"e3092602-9d5c-4442-8341-f29a69cb7c56\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") "
Jul 15 20:09:06.075868 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.075756    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3092602-9d5c-4442-8341-f29a69cb7c56-console-serving-cert\") pod \"e3092602-9d5c-4442-8341-f29a69cb7c56\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") "
Jul 15 20:09:06.075868 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.075785    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shlf2\" (UniqueName: \"kubernetes.io/projected/e3092602-9d5c-4442-8341-f29a69cb7c56-kube-api-access-shlf2\") pod \"e3092602-9d5c-4442-8341-f29a69cb7c56\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") "
Jul 15 20:09:06.075868 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.075817    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-service-ca\") pod \"e3092602-9d5c-4442-8341-f29a69cb7c56\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") "
Jul 15 20:09:06.075868 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.075864    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3092602-9d5c-4442-8341-f29a69cb7c56-console-oauth-config\") pod \"e3092602-9d5c-4442-8341-f29a69cb7c56\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") "
Jul 15 20:09:06.076120 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.075912    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-oauth-serving-cert\") pod \"e3092602-9d5c-4442-8341-f29a69cb7c56\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") "
Jul 15 20:09:06.076120 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.076007    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-console-config\") pod \"e3092602-9d5c-4442-8341-f29a69cb7c56\" (UID: \"e3092602-9d5c-4442-8341-f29a69cb7c56\") "
Jul 15 20:09:06.076215 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.076191    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e3092602-9d5c-4442-8341-f29a69cb7c56" (UID: "e3092602-9d5c-4442-8341-f29a69cb7c56"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:09:06.076437 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.076409    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-trusted-ca-bundle\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:09:06.076574 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.076502    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-console-config" (OuterVolumeSpecName: "console-config") pod "e3092602-9d5c-4442-8341-f29a69cb7c56" (UID: "e3092602-9d5c-4442-8341-f29a69cb7c56"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:09:06.076574 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.076512    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-service-ca" (OuterVolumeSpecName: "service-ca") pod "e3092602-9d5c-4442-8341-f29a69cb7c56" (UID: "e3092602-9d5c-4442-8341-f29a69cb7c56"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:09:06.076851 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.076812    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e3092602-9d5c-4442-8341-f29a69cb7c56" (UID: "e3092602-9d5c-4442-8341-f29a69cb7c56"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:09:06.078381 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.078349    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3092602-9d5c-4442-8341-f29a69cb7c56-kube-api-access-shlf2" (OuterVolumeSpecName: "kube-api-access-shlf2") pod "e3092602-9d5c-4442-8341-f29a69cb7c56" (UID: "e3092602-9d5c-4442-8341-f29a69cb7c56"). InnerVolumeSpecName "kube-api-access-shlf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:09:06.078621 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.078591    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3092602-9d5c-4442-8341-f29a69cb7c56-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e3092602-9d5c-4442-8341-f29a69cb7c56" (UID: "e3092602-9d5c-4442-8341-f29a69cb7c56"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:09:06.078621 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.078605    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3092602-9d5c-4442-8341-f29a69cb7c56-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e3092602-9d5c-4442-8341-f29a69cb7c56" (UID: "e3092602-9d5c-4442-8341-f29a69cb7c56"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:09:06.177262 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.177231    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-oauth-serving-cert\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:09:06.177262 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.177258    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-console-config\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:09:06.177262 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.177267    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3092602-9d5c-4442-8341-f29a69cb7c56-console-serving-cert\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:09:06.177484 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.177275    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shlf2\" (UniqueName: \"kubernetes.io/projected/e3092602-9d5c-4442-8341-f29a69cb7c56-kube-api-access-shlf2\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:09:06.177484 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.177288    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3092602-9d5c-4442-8341-f29a69cb7c56-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:09:06.177484 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:06.177296    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3092602-9d5c-4442-8341-f29a69cb7c56-console-oauth-config\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:09:07.026330 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:07.026300    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769f77b954-qpszl"
Jul 15 20:09:07.026680 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:07.026285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769f77b954-qpszl" event={"ID":"e3092602-9d5c-4442-8341-f29a69cb7c56","Type":"ContainerDied","Data":"4c7f3e2e2237b04bdb7cdaf53de6824fa7e97499b50331babfb644c1286c3fd3"}
Jul 15 20:09:07.026680 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:07.026428    2560 scope.go:117] "RemoveContainer" containerID="989c4350563bd4948b41137c3295261482bbbf87a9355ccbe235be25326ac7c4"
Jul 15 20:09:07.883892 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:07.883858    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-769f77b954-qpszl"]
Jul 15 20:09:07.889494 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:07.889469    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-769f77b954-qpszl"]
Jul 15 20:09:08.895452 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:08.895418    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3092602-9d5c-4442-8341-f29a69cb7c56" path="/var/lib/kubelet/pods/e3092602-9d5c-4442-8341-f29a69cb7c56/volumes"
Jul 15 20:09:22.785980 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:22.785885    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:09:22.785980 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:22.785959    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:09:37.881215 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:37.881176    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:09:49.168895 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:49.168858    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:09:58.581599 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:09:58.581561    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:10:07.575165 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:10:07.575127    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:10:18.086312 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:10:18.086279    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:10:27.474516 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:10:27.474479    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:10:38.569869 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:10:38.569839    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:10:47.881859 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:10:47.881822    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:11:10.980031 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:11:10.979996    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:11:21.671686 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:11:21.671650    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:11:44.994646 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:11:44.994613    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:11:55.569121 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:11:55.569085    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:12:09.473737 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:12:09.473703    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:12:21.376171 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:12:21.376089    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:12:31.082291 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:12:31.082262    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:12:40.684260 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:12:40.684224    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:12:51.485684 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:12:51.485647    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:13:15.466389 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:15.466357    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"]
Jul 15 20:13:15.466918 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:15.466557    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx" podUID="cf986f28-8e6b-4641-a91f-c3d9fd5da59f" containerName="manager" containerID="cri-o://b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212" gracePeriod=10
Jul 15 20:13:17.928165 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:17.928135    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"
Jul 15 20:13:17.971697 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:17.971609    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf986f28-8e6b-4641-a91f-c3d9fd5da59f-extensions-socket-volume\") pod \"cf986f28-8e6b-4641-a91f-c3d9fd5da59f\" (UID: \"cf986f28-8e6b-4641-a91f-c3d9fd5da59f\") "
Jul 15 20:13:17.971697 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:17.971689    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r5pf\" (UniqueName: \"kubernetes.io/projected/cf986f28-8e6b-4641-a91f-c3d9fd5da59f-kube-api-access-5r5pf\") pod \"cf986f28-8e6b-4641-a91f-c3d9fd5da59f\" (UID: \"cf986f28-8e6b-4641-a91f-c3d9fd5da59f\") "
Jul 15 20:13:17.972090 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:17.972065    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf986f28-8e6b-4641-a91f-c3d9fd5da59f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cf986f28-8e6b-4641-a91f-c3d9fd5da59f" (UID: "cf986f28-8e6b-4641-a91f-c3d9fd5da59f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:13:17.974052 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:17.974025    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf986f28-8e6b-4641-a91f-c3d9fd5da59f-kube-api-access-5r5pf" (OuterVolumeSpecName: "kube-api-access-5r5pf") pod "cf986f28-8e6b-4641-a91f-c3d9fd5da59f" (UID: "cf986f28-8e6b-4641-a91f-c3d9fd5da59f"). InnerVolumeSpecName "kube-api-access-5r5pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:13:18.072824 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:18.072789    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r5pf\" (UniqueName: \"kubernetes.io/projected/cf986f28-8e6b-4641-a91f-c3d9fd5da59f-kube-api-access-5r5pf\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:13:18.072824 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:18.072815    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf986f28-8e6b-4641-a91f-c3d9fd5da59f-extensions-socket-volume\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:13:18.315906 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:18.315821    2560 generic.go:356] "Generic (PLEG): container finished" podID="cf986f28-8e6b-4641-a91f-c3d9fd5da59f" containerID="b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212" exitCode=0
Jul 15 20:13:18.315906 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:18.315866    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"
Jul 15 20:13:18.316108 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:18.315913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx" event={"ID":"cf986f28-8e6b-4641-a91f-c3d9fd5da59f","Type":"ContainerDied","Data":"b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212"}
Jul 15 20:13:18.316108 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:18.315983    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx" event={"ID":"cf986f28-8e6b-4641-a91f-c3d9fd5da59f","Type":"ContainerDied","Data":"e578d28ad65ed95301fc351719cbe5428e4b5ba7ec08705cba921d280d86b52a"}
Jul 15 20:13:18.316108 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:18.316006    2560 scope.go:117] "RemoveContainer" containerID="b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212"
Jul 15 20:13:18.332878 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:18.332855    2560 scope.go:117] "RemoveContainer" containerID="b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212"
Jul 15 20:13:18.333249 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:13:18.333226    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212\": container with ID starting with b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212 not found: ID does not exist" containerID="b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212"
Jul 15 20:13:18.333338 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:18.333255    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212"} err="failed to get container status \"b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212\": rpc error: code = NotFound desc = could not find container \"b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212\": container with ID starting with b7b21709af3cb0b630e35c84162549b257e881dcb59c307fc53636a8ee133212 not found: ID does not exist"
Jul 15 20:13:18.343926 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:18.343897    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"]
Jul 15 20:13:18.349035 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:18.349015    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwrlx"]
Jul 15 20:13:18.894544 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:13:18.894508    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf986f28-8e6b-4641-a91f-c3d9fd5da59f" path="/var/lib/kubelet/pods/cf986f28-8e6b-4641-a91f-c3d9fd5da59f/volumes"
Jul 15 20:14:16.592979 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.592925    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"]
Jul 15 20:14:16.593573 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.593438    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3092602-9d5c-4442-8341-f29a69cb7c56" containerName="console"
Jul 15 20:14:16.593573 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.593457    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3092602-9d5c-4442-8341-f29a69cb7c56" containerName="console"
Jul 15 20:14:16.593573 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.593476    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf986f28-8e6b-4641-a91f-c3d9fd5da59f" containerName="manager"
Jul 15 20:14:16.593573 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.593484    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf986f28-8e6b-4641-a91f-c3d9fd5da59f" containerName="manager"
Jul 15 20:14:16.593778 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.593578    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3092602-9d5c-4442-8341-f29a69cb7c56" containerName="console"
Jul 15 20:14:16.593778 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.593589    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf986f28-8e6b-4641-a91f-c3d9fd5da59f" containerName="manager"
Jul 15 20:14:16.596583 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.596562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"
Jul 15 20:14:16.599055 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.599036    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-44jlp\""
Jul 15 20:14:16.613603 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.613576    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"]
Jul 15 20:14:16.663020 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.662983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a36aefb8-d308-4014-8c21-0b4351a7e0df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2k9dc\" (UID: \"a36aefb8-d308-4014-8c21-0b4351a7e0df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"
Jul 15 20:14:16.663187 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.663048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp8vl\" (UniqueName: \"kubernetes.io/projected/a36aefb8-d308-4014-8c21-0b4351a7e0df-kube-api-access-lp8vl\") pod \"kuadrant-operator-controller-manager-86878c769f-2k9dc\" (UID: \"a36aefb8-d308-4014-8c21-0b4351a7e0df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"
Jul 15 20:14:16.764062 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.764021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp8vl\" (UniqueName: \"kubernetes.io/projected/a36aefb8-d308-4014-8c21-0b4351a7e0df-kube-api-access-lp8vl\") pod \"kuadrant-operator-controller-manager-86878c769f-2k9dc\" (UID: \"a36aefb8-d308-4014-8c21-0b4351a7e0df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"
Jul 15 20:14:16.764223 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.764094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a36aefb8-d308-4014-8c21-0b4351a7e0df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2k9dc\" (UID: \"a36aefb8-d308-4014-8c21-0b4351a7e0df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"
Jul 15 20:14:16.764480 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.764462    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a36aefb8-d308-4014-8c21-0b4351a7e0df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2k9dc\" (UID: \"a36aefb8-d308-4014-8c21-0b4351a7e0df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"
Jul 15 20:14:16.774297 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.774274    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp8vl\" (UniqueName: \"kubernetes.io/projected/a36aefb8-d308-4014-8c21-0b4351a7e0df-kube-api-access-lp8vl\") pod \"kuadrant-operator-controller-manager-86878c769f-2k9dc\" (UID: \"a36aefb8-d308-4014-8c21-0b4351a7e0df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"
Jul 15 20:14:16.906227 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:16.906195    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"
Jul 15 20:14:17.077346 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:17.077317    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"]
Jul 15 20:14:17.079335 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:14:17.079305    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36aefb8_d308_4014_8c21_0b4351a7e0df.slice/crio-ee6096c7afdccbab606c8fc1946f936241627f96bca0268d5a587a410ce6b3ea WatchSource:0}: Error finding container ee6096c7afdccbab606c8fc1946f936241627f96bca0268d5a587a410ce6b3ea: Status 404 returned error can't find the container with id ee6096c7afdccbab606c8fc1946f936241627f96bca0268d5a587a410ce6b3ea
Jul 15 20:14:17.622090 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:17.622046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc" event={"ID":"a36aefb8-d308-4014-8c21-0b4351a7e0df","Type":"ContainerStarted","Data":"1b77fc7f17ffc0a7b695ea6f4f2b9deb21cb8e8bcd02911cef20910799d6bb3e"}
Jul 15 20:14:17.622534 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:17.622244    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"
Jul 15 20:14:17.622534 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:17.622276    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc" event={"ID":"a36aefb8-d308-4014-8c21-0b4351a7e0df","Type":"ContainerStarted","Data":"ee6096c7afdccbab606c8fc1946f936241627f96bca0268d5a587a410ce6b3ea"}
Jul 15 20:14:17.647719 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:17.647666    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc" podStartSLOduration=1.6476511679999999 podStartE2EDuration="1.647651168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:14:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:14:17.644707947 +0000 UTC m=+1195.281825249" watchObservedRunningTime="2026-07-15 20:14:17.647651168 +0000 UTC m=+1195.284768457"
Jul 15 20:14:22.818830 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:22.818800    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:14:22.821259 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:22.821236    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:14:28.629380 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:28.629343    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k9dc"
Jul 15 20:14:38.773836 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:38.773800    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:14:50.407787 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:50.407751    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:14:59.478542 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:14:59.478504    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:15:13.207382 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:15:13.207350    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:15:22.381076 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:15:22.381040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:15:33.076923 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:15:33.076884    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:15:42.182135 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:15:42.182100    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:15:53.377979 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:15:53.377917    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:16:03.780789 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:16:03.780757    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:16:12.680096 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:16:12.680060    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:16:23.270771 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:16:23.270736    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:16:45.186119 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:16:45.186039    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:16:53.999275 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:16:53.999240    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:17:05.571226 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:17:05.571195    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:17:15.173346 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:17:15.173309    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:17:24.583427 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:17:24.583395    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:17:35.083663 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:17:35.083627    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:17:45.477476 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:17:45.477440    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:17:54.473544 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:17:54.473510    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:18:03.777438 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:18:03.777404    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:18:14.872361 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:18:14.872281    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:18:31.984917 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:18:31.984873    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:18:40.587768 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:18:40.587732    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:18:51.577237 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:18:51.577201    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:19:01.182420 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:19:01.182382    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:19:10.767631 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:19:10.767588    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:19:22.850697 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:19:22.850661    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:19:22.854148 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:19:22.854126    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:19:23.375053 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:19:23.375017    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:19:32.474501 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:19:32.474463    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:19:43.180432 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:19:43.180403    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:19:55.085409 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:19:55.085374    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:20:06.581500 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:06.581464    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:20:15.271500 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:15.271465    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:20:28.273090 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:28.273051    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:20:36.575958 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:36.575898    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:20:43.149877 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.149835    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"]
Jul 15 20:20:43.153170 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.153153    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:20:43.155368 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.155341    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c8d33b32-serving-cert\""
Jul 15 20:20:43.163070 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.163045    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"]
Jul 15 20:20:43.318767 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.318733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad5648d-c320-41e3-b485-ac76f32c8f6a-maas-api-tls\") pod \"maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8\" (UID: \"fad5648d-c320-41e3-b485-ac76f32c8f6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:20:43.318968 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.318799    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6z2p\" (UniqueName: \"kubernetes.io/projected/fad5648d-c320-41e3-b485-ac76f32c8f6a-kube-api-access-x6z2p\") pod \"maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8\" (UID: \"fad5648d-c320-41e3-b485-ac76f32c8f6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:20:43.318968 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.318862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad5648d-c320-41e3-b485-ac76f32c8f6a-openshift-service-ca\") pod \"maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8\" (UID: \"fad5648d-c320-41e3-b485-ac76f32c8f6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:20:43.419530 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.419451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad5648d-c320-41e3-b485-ac76f32c8f6a-maas-api-tls\") pod \"maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8\" (UID: \"fad5648d-c320-41e3-b485-ac76f32c8f6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:20:43.419530 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.419495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6z2p\" (UniqueName: \"kubernetes.io/projected/fad5648d-c320-41e3-b485-ac76f32c8f6a-kube-api-access-x6z2p\") pod \"maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8\" (UID: \"fad5648d-c320-41e3-b485-ac76f32c8f6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:20:43.419712 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.419622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad5648d-c320-41e3-b485-ac76f32c8f6a-openshift-service-ca\") pod \"maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8\" (UID: \"fad5648d-c320-41e3-b485-ac76f32c8f6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:20:43.420256 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.420234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad5648d-c320-41e3-b485-ac76f32c8f6a-openshift-service-ca\") pod \"maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8\" (UID: \"fad5648d-c320-41e3-b485-ac76f32c8f6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:20:43.422142 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.422114    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad5648d-c320-41e3-b485-ac76f32c8f6a-maas-api-tls\") pod \"maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8\" (UID: \"fad5648d-c320-41e3-b485-ac76f32c8f6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:20:43.429077 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.429049    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6z2p\" (UniqueName: \"kubernetes.io/projected/fad5648d-c320-41e3-b485-ac76f32c8f6a-kube-api-access-x6z2p\") pod \"maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8\" (UID: \"fad5648d-c320-41e3-b485-ac76f32c8f6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:20:43.464902 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.464879    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:20:43.600404 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.600378    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"]
Jul 15 20:20:43.602046 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:20:43.602012    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad5648d_c320_41e3_b485_ac76f32c8f6a.slice/crio-3472d42c995ca1a489c52e757fa397e8d5ff4ecdd0be2db3059358d98f3bb847 WatchSource:0}: Error finding container 3472d42c995ca1a489c52e757fa397e8d5ff4ecdd0be2db3059358d98f3bb847: Status 404 returned error can't find the container with id 3472d42c995ca1a489c52e757fa397e8d5ff4ecdd0be2db3059358d98f3bb847
Jul 15 20:20:43.603309 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.603290    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 20:20:43.668052 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:43.667997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8" event={"ID":"fad5648d-c320-41e3-b485-ac76f32c8f6a","Type":"ContainerStarted","Data":"3472d42c995ca1a489c52e757fa397e8d5ff4ecdd0be2db3059358d98f3bb847"}
Jul 15 20:20:45.679806 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:45.679756    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8" event={"ID":"fad5648d-c320-41e3-b485-ac76f32c8f6a","Type":"ContainerStarted","Data":"a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d"}
Jul 15 20:20:45.680247 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:45.679911    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:20:45.701661 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:45.701613    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8" podStartSLOduration=1.0188139 podStartE2EDuration="2.701600376s" totalImagesPullingTime="1.682786476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:20:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:20:45.700865683 +0000 UTC m=+1583.337982974" watchObservedRunningTime="2026-07-15 20:20:45.701600376 +0000 UTC m=+1583.338717665"
Jul 15 20:20:46.972066 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:46.972019    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:20:51.690569 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:20:51.690540    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:21:48.205694 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:48.205653    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp"]
Jul 15 20:21:48.209286 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:48.209264    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp"
Jul 15 20:21:48.212064 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:48.212042    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-grvfv\""
Jul 15 20:21:48.217777 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:48.217755    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp"]
Jul 15 20:21:48.293309 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:48.293275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43611b7-ec66-4cf2-bc63-d0212166de35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp\" (UID: \"a43611b7-ec66-4cf2-bc63-d0212166de35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp"
Jul 15 20:21:48.394724 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:48.394690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43611b7-ec66-4cf2-bc63-d0212166de35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp\" (UID: \"a43611b7-ec66-4cf2-bc63-d0212166de35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp"
Jul 15 20:21:48.395347 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:48.395323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43611b7-ec66-4cf2-bc63-d0212166de35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp\" (UID: \"a43611b7-ec66-4cf2-bc63-d0212166de35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp"
Jul 15 20:21:48.520559 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:48.520480    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp"
Jul 15 20:21:48.654715 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:48.654691    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp"]
Jul 15 20:21:48.657085 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:21:48.657056    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43611b7_ec66_4cf2_bc63_d0212166de35.slice/crio-885fdb4b10074ffdecc18329386808c8cbbd7ec04b8b380945f8f153bcdaa390 WatchSource:0}: Error finding container 885fdb4b10074ffdecc18329386808c8cbbd7ec04b8b380945f8f153bcdaa390: Status 404 returned error can't find the container with id 885fdb4b10074ffdecc18329386808c8cbbd7ec04b8b380945f8f153bcdaa390
Jul 15 20:21:49.008930 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:49.008894    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp" event={"ID":"a43611b7-ec66-4cf2-bc63-d0212166de35","Type":"ContainerStarted","Data":"885fdb4b10074ffdecc18329386808c8cbbd7ec04b8b380945f8f153bcdaa390"}
Jul 15 20:21:52.027231 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:52.027193    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp" event={"ID":"a43611b7-ec66-4cf2-bc63-d0212166de35","Type":"ContainerStarted","Data":"8370bd9d17d81bc79013a3041a77078b9ca35631344cc6a69f0457088e4c8a8d"}
Jul 15 20:21:52.043983 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:52.043920    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp" podStartSLOduration=1.4241045589999999 podStartE2EDuration="4.043904564s" totalImagesPullingTime="2.619800005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:21:52.043105635 +0000 UTC m=+1649.680222924" watchObservedRunningTime="2026-07-15 20:21:52.043904564 +0000 UTC m=+1649.681021854"
Jul 15 20:21:53.033763 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:53.033727    2560 generic.go:356] "Generic (PLEG): container finished" podID="a43611b7-ec66-4cf2-bc63-d0212166de35" containerID="8370bd9d17d81bc79013a3041a77078b9ca35631344cc6a69f0457088e4c8a8d" exitCode=0
Jul 15 20:21:53.034175 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:53.033795    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp" event={"ID":"a43611b7-ec66-4cf2-bc63-d0212166de35","Type":"ContainerDied","Data":"8370bd9d17d81bc79013a3041a77078b9ca35631344cc6a69f0457088e4c8a8d"}
Jul 15 20:21:54.169968 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:54.169923    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp"
Jul 15 20:21:54.251704 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:54.251675    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43611b7-ec66-4cf2-bc63-d0212166de35-maas-api-service-ca\") pod \"a43611b7-ec66-4cf2-bc63-d0212166de35\" (UID: \"a43611b7-ec66-4cf2-bc63-d0212166de35\") "
Jul 15 20:21:54.252090 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:54.252068    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a43611b7-ec66-4cf2-bc63-d0212166de35-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a43611b7-ec66-4cf2-bc63-d0212166de35" (UID: "a43611b7-ec66-4cf2-bc63-d0212166de35"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:21:54.353135 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:54.353110    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43611b7-ec66-4cf2-bc63-d0212166de35-maas-api-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:21:55.044790 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:55.044755    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp"
Jul 15 20:21:55.044968 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:55.044802    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp" event={"ID":"a43611b7-ec66-4cf2-bc63-d0212166de35","Type":"ContainerDied","Data":"885fdb4b10074ffdecc18329386808c8cbbd7ec04b8b380945f8f153bcdaa390"}
Jul 15 20:21:55.044968 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:55.044845    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="885fdb4b10074ffdecc18329386808c8cbbd7ec04b8b380945f8f153bcdaa390"
Jul 15 20:21:58.644016 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:58.643984    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"]
Jul 15 20:21:58.644502 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:58.644229    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8" podUID="fad5648d-c320-41e3-b485-ac76f32c8f6a" containerName="maas-api" containerID="cri-o://a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d" gracePeriod=30
Jul 15 20:21:58.895866 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:58.895807    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:21:58.991598 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:58.991571    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6z2p\" (UniqueName: \"kubernetes.io/projected/fad5648d-c320-41e3-b485-ac76f32c8f6a-kube-api-access-x6z2p\") pod \"fad5648d-c320-41e3-b485-ac76f32c8f6a\" (UID: \"fad5648d-c320-41e3-b485-ac76f32c8f6a\") "
Jul 15 20:21:58.991781 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:58.991613    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad5648d-c320-41e3-b485-ac76f32c8f6a-openshift-service-ca\") pod \"fad5648d-c320-41e3-b485-ac76f32c8f6a\" (UID: \"fad5648d-c320-41e3-b485-ac76f32c8f6a\") "
Jul 15 20:21:58.991781 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:58.991653    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad5648d-c320-41e3-b485-ac76f32c8f6a-maas-api-tls\") pod \"fad5648d-c320-41e3-b485-ac76f32c8f6a\" (UID: \"fad5648d-c320-41e3-b485-ac76f32c8f6a\") "
Jul 15 20:21:58.991998 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:58.991975    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fad5648d-c320-41e3-b485-ac76f32c8f6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fad5648d-c320-41e3-b485-ac76f32c8f6a" (UID: "fad5648d-c320-41e3-b485-ac76f32c8f6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:21:58.993948 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:58.993906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fad5648d-c320-41e3-b485-ac76f32c8f6a-kube-api-access-x6z2p" (OuterVolumeSpecName: "kube-api-access-x6z2p") pod "fad5648d-c320-41e3-b485-ac76f32c8f6a" (UID: "fad5648d-c320-41e3-b485-ac76f32c8f6a"). InnerVolumeSpecName "kube-api-access-x6z2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:21:58.994040 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:58.993925    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fad5648d-c320-41e3-b485-ac76f32c8f6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fad5648d-c320-41e3-b485-ac76f32c8f6a" (UID: "fad5648d-c320-41e3-b485-ac76f32c8f6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:21:59.065918 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:59.065888    2560 generic.go:356] "Generic (PLEG): container finished" podID="fad5648d-c320-41e3-b485-ac76f32c8f6a" containerID="a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d" exitCode=0
Jul 15 20:21:59.066098 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:59.065930    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"
Jul 15 20:21:59.066098 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:59.065974    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8" event={"ID":"fad5648d-c320-41e3-b485-ac76f32c8f6a","Type":"ContainerDied","Data":"a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d"}
Jul 15 20:21:59.066098 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:59.066039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8" event={"ID":"fad5648d-c320-41e3-b485-ac76f32c8f6a","Type":"ContainerDied","Data":"3472d42c995ca1a489c52e757fa397e8d5ff4ecdd0be2db3059358d98f3bb847"}
Jul 15 20:21:59.066098 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:59.066070    2560 scope.go:117] "RemoveContainer" containerID="a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d"
Jul 15 20:21:59.075204 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:59.075185    2560 scope.go:117] "RemoveContainer" containerID="a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d"
Jul 15 20:21:59.075456 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:21:59.075438    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d\": container with ID starting with a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d not found: ID does not exist" containerID="a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d"
Jul 15 20:21:59.075504 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:59.075465    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d"} err="failed to get container status \"a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d\": rpc error: code = NotFound desc = could not find container \"a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d\": container with ID starting with a143dc505ec6eb2627d5b6ded2748a63cc583180ac80a2a0d73e91e5ba07a26d not found: ID does not exist"
Jul 15 20:21:59.088380 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:59.088356    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"]
Jul 15 20:21:59.090519 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:59.090498    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c8d33b32-7dbcc95cf7-ts8h8"]
Jul 15 20:21:59.093125 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:59.093103    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6z2p\" (UniqueName: \"kubernetes.io/projected/fad5648d-c320-41e3-b485-ac76f32c8f6a-kube-api-access-x6z2p\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:21:59.093125 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:59.093122    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad5648d-c320-41e3-b485-ac76f32c8f6a-openshift-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:21:59.093283 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:21:59.093133    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad5648d-c320-41e3-b485-ac76f32c8f6a-maas-api-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:22:00.896037 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:00.895997    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fad5648d-c320-41e3-b485-ac76f32c8f6a" path="/var/lib/kubelet/pods/fad5648d-c320-41e3-b485-ac76f32c8f6a/volumes"
Jul 15 20:22:01.384299 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:01.384266    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:22:15.426140 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.426104    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"]
Jul 15 20:22:15.426702 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.426679    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43611b7-ec66-4cf2-bc63-d0212166de35" containerName="revoke-keys"
Jul 15 20:22:15.426920 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.426898    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43611b7-ec66-4cf2-bc63-d0212166de35" containerName="revoke-keys"
Jul 15 20:22:15.427053 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.426973    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fad5648d-c320-41e3-b485-ac76f32c8f6a" containerName="maas-api"
Jul 15 20:22:15.427053 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.426983    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fad5648d-c320-41e3-b485-ac76f32c8f6a" containerName="maas-api"
Jul 15 20:22:15.427174 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.427099    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a43611b7-ec66-4cf2-bc63-d0212166de35" containerName="revoke-keys"
Jul 15 20:22:15.427174 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.427110    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fad5648d-c320-41e3-b485-ac76f32c8f6a" containerName="maas-api"
Jul 15 20:22:15.433587 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.433568    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:22:15.436045 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.436024    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-7ac342b1-serving-cert\""
Jul 15 20:22:15.442433 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.442405    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"]
Jul 15 20:22:15.531321 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.531291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/492d5423-8b03-45bd-b20b-799e4c76a76b-openshift-service-ca\") pod \"maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4\" (UID: \"492d5423-8b03-45bd-b20b-799e4c76a76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:22:15.531508 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.531329    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vw9f\" (UniqueName: \"kubernetes.io/projected/492d5423-8b03-45bd-b20b-799e4c76a76b-kube-api-access-2vw9f\") pod \"maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4\" (UID: \"492d5423-8b03-45bd-b20b-799e4c76a76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:22:15.531584 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.531523    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/492d5423-8b03-45bd-b20b-799e4c76a76b-maas-api-tls\") pod \"maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4\" (UID: \"492d5423-8b03-45bd-b20b-799e4c76a76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:22:15.632705 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.632666    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/492d5423-8b03-45bd-b20b-799e4c76a76b-maas-api-tls\") pod \"maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4\" (UID: \"492d5423-8b03-45bd-b20b-799e4c76a76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:22:15.632881 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.632716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/492d5423-8b03-45bd-b20b-799e4c76a76b-openshift-service-ca\") pod \"maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4\" (UID: \"492d5423-8b03-45bd-b20b-799e4c76a76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:22:15.632881 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.632736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vw9f\" (UniqueName: \"kubernetes.io/projected/492d5423-8b03-45bd-b20b-799e4c76a76b-kube-api-access-2vw9f\") pod \"maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4\" (UID: \"492d5423-8b03-45bd-b20b-799e4c76a76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:22:15.633329 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.633308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/492d5423-8b03-45bd-b20b-799e4c76a76b-openshift-service-ca\") pod \"maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4\" (UID: \"492d5423-8b03-45bd-b20b-799e4c76a76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:22:15.635148 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.635131    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/492d5423-8b03-45bd-b20b-799e4c76a76b-maas-api-tls\") pod \"maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4\" (UID: \"492d5423-8b03-45bd-b20b-799e4c76a76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:22:15.644860 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.644837    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vw9f\" (UniqueName: \"kubernetes.io/projected/492d5423-8b03-45bd-b20b-799e4c76a76b-kube-api-access-2vw9f\") pod \"maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4\" (UID: \"492d5423-8b03-45bd-b20b-799e4c76a76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:22:15.745494 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.745395    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:22:15.882688 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:15.882664    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"]
Jul 15 20:22:15.884832 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:22:15.884809    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod492d5423_8b03_45bd_b20b_799e4c76a76b.slice/crio-3ba75839ce00a5bbb7ae11e6e691a0e77a86130042e948ffbfb406b8b77ba9c0 WatchSource:0}: Error finding container 3ba75839ce00a5bbb7ae11e6e691a0e77a86130042e948ffbfb406b8b77ba9c0: Status 404 returned error can't find the container with id 3ba75839ce00a5bbb7ae11e6e691a0e77a86130042e948ffbfb406b8b77ba9c0
Jul 15 20:22:16.153262 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:16.153224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4" event={"ID":"492d5423-8b03-45bd-b20b-799e4c76a76b","Type":"ContainerStarted","Data":"3ba75839ce00a5bbb7ae11e6e691a0e77a86130042e948ffbfb406b8b77ba9c0"}
Jul 15 20:22:17.160691 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:17.160644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4" event={"ID":"492d5423-8b03-45bd-b20b-799e4c76a76b","Type":"ContainerStarted","Data":"3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62"}
Jul 15 20:22:17.161121 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:17.160711    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:22:17.193696 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:17.193642    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4" podStartSLOduration=1.6956782540000002 podStartE2EDuration="2.193625131s" totalImagesPullingTime="497.946877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:22:17.191349221 +0000 UTC m=+1674.828466522" watchObservedRunningTime="2026-07-15 20:22:17.193625131 +0000 UTC m=+1674.830742399"
Jul 15 20:22:20.172646 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:20.172616    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:22:23.172294 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:22:23.172267    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:23:09.904510 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:09.904478    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f"]
Jul 15 20:23:09.908089 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:09.908069    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f"
Jul 15 20:23:09.910620 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:09.910598    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-grvfv\""
Jul 15 20:23:09.919986 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:09.919960    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f"]
Jul 15 20:23:10.005489 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:10.005456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd01f72c-640e-4b0c-b12c-0c00ab61d948-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f\" (UID: \"cd01f72c-640e-4b0c-b12c-0c00ab61d948\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f"
Jul 15 20:23:10.106873 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:10.106835    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd01f72c-640e-4b0c-b12c-0c00ab61d948-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f\" (UID: \"cd01f72c-640e-4b0c-b12c-0c00ab61d948\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f"
Jul 15 20:23:10.107450 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:10.107421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd01f72c-640e-4b0c-b12c-0c00ab61d948-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f\" (UID: \"cd01f72c-640e-4b0c-b12c-0c00ab61d948\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f"
Jul 15 20:23:10.219732 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:10.219655    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f"
Jul 15 20:23:10.370121 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:10.370078    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f"]
Jul 15 20:23:10.436112 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:10.436081    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f" event={"ID":"cd01f72c-640e-4b0c-b12c-0c00ab61d948","Type":"ContainerStarted","Data":"02ad7641b62e609498adcafc3e681cd5131ba1dddfbd3bcba83e24ba7dc54f25"}
Jul 15 20:23:11.442565 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:11.442533    2560 generic.go:356] "Generic (PLEG): container finished" podID="cd01f72c-640e-4b0c-b12c-0c00ab61d948" containerID="e7b21d15403c513770c06799199c634469e14aa793d747da72b506eea3f48f8d" exitCode=0
Jul 15 20:23:11.443024 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:11.442615    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f" event={"ID":"cd01f72c-640e-4b0c-b12c-0c00ab61d948","Type":"ContainerDied","Data":"e7b21d15403c513770c06799199c634469e14aa793d747da72b506eea3f48f8d"}
Jul 15 20:23:12.581862 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:12.581839    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f"
Jul 15 20:23:12.732660 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:12.732571    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd01f72c-640e-4b0c-b12c-0c00ab61d948-maas-api-service-ca\") pod \"cd01f72c-640e-4b0c-b12c-0c00ab61d948\" (UID: \"cd01f72c-640e-4b0c-b12c-0c00ab61d948\") "
Jul 15 20:23:12.732923 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:12.732897    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd01f72c-640e-4b0c-b12c-0c00ab61d948-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cd01f72c-640e-4b0c-b12c-0c00ab61d948" (UID: "cd01f72c-640e-4b0c-b12c-0c00ab61d948"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:23:12.833356 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:12.833323    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd01f72c-640e-4b0c-b12c-0c00ab61d948-maas-api-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:23:13.454376 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:13.454352    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f"
Jul 15 20:23:13.454559 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:13.454351    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f" event={"ID":"cd01f72c-640e-4b0c-b12c-0c00ab61d948","Type":"ContainerDied","Data":"02ad7641b62e609498adcafc3e681cd5131ba1dddfbd3bcba83e24ba7dc54f25"}
Jul 15 20:23:13.454559 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:13.454474    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02ad7641b62e609498adcafc3e681cd5131ba1dddfbd3bcba83e24ba7dc54f25"
Jul 15 20:23:20.399972 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:20.399920    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"]
Jul 15 20:23:20.400382 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:20.400227    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4" podUID="492d5423-8b03-45bd-b20b-799e4c76a76b" containerName="maas-api" containerID="cri-o://3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62" gracePeriod=30
Jul 15 20:23:20.656723 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:20.656668    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:23:20.695213 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:20.695182    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vw9f\" (UniqueName: \"kubernetes.io/projected/492d5423-8b03-45bd-b20b-799e4c76a76b-kube-api-access-2vw9f\") pod \"492d5423-8b03-45bd-b20b-799e4c76a76b\" (UID: \"492d5423-8b03-45bd-b20b-799e4c76a76b\") "
Jul 15 20:23:20.695353 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:20.695245    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/492d5423-8b03-45bd-b20b-799e4c76a76b-openshift-service-ca\") pod \"492d5423-8b03-45bd-b20b-799e4c76a76b\" (UID: \"492d5423-8b03-45bd-b20b-799e4c76a76b\") "
Jul 15 20:23:20.695353 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:20.695337    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/492d5423-8b03-45bd-b20b-799e4c76a76b-maas-api-tls\") pod \"492d5423-8b03-45bd-b20b-799e4c76a76b\" (UID: \"492d5423-8b03-45bd-b20b-799e4c76a76b\") "
Jul 15 20:23:20.695574 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:20.695553    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/492d5423-8b03-45bd-b20b-799e4c76a76b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "492d5423-8b03-45bd-b20b-799e4c76a76b" (UID: "492d5423-8b03-45bd-b20b-799e4c76a76b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:23:20.697368 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:20.697341    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/492d5423-8b03-45bd-b20b-799e4c76a76b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "492d5423-8b03-45bd-b20b-799e4c76a76b" (UID: "492d5423-8b03-45bd-b20b-799e4c76a76b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:23:20.697471 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:20.697403    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/492d5423-8b03-45bd-b20b-799e4c76a76b-kube-api-access-2vw9f" (OuterVolumeSpecName: "kube-api-access-2vw9f") pod "492d5423-8b03-45bd-b20b-799e4c76a76b" (UID: "492d5423-8b03-45bd-b20b-799e4c76a76b"). InnerVolumeSpecName "kube-api-access-2vw9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:23:20.795991 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:20.795928    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vw9f\" (UniqueName: \"kubernetes.io/projected/492d5423-8b03-45bd-b20b-799e4c76a76b-kube-api-access-2vw9f\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:23:20.795991 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:20.795988    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/492d5423-8b03-45bd-b20b-799e4c76a76b-openshift-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:23:20.795991 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:20.795998    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/492d5423-8b03-45bd-b20b-799e4c76a76b-maas-api-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:23:21.495918 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:21.495881    2560 generic.go:356] "Generic (PLEG): container finished" podID="492d5423-8b03-45bd-b20b-799e4c76a76b" containerID="3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62" exitCode=0
Jul 15 20:23:21.496435 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:21.495948    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"
Jul 15 20:23:21.496435 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:21.495969    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4" event={"ID":"492d5423-8b03-45bd-b20b-799e4c76a76b","Type":"ContainerDied","Data":"3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62"}
Jul 15 20:23:21.496435 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:21.496031    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4" event={"ID":"492d5423-8b03-45bd-b20b-799e4c76a76b","Type":"ContainerDied","Data":"3ba75839ce00a5bbb7ae11e6e691a0e77a86130042e948ffbfb406b8b77ba9c0"}
Jul 15 20:23:21.496435 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:21.496056    2560 scope.go:117] "RemoveContainer" containerID="3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62"
Jul 15 20:23:21.504868 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:21.504852    2560 scope.go:117] "RemoveContainer" containerID="3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62"
Jul 15 20:23:21.505142 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:23:21.505121    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62\": container with ID starting with 3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62 not found: ID does not exist" containerID="3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62"
Jul 15 20:23:21.505238 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:21.505154    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62"} err="failed to get container status \"3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62\": rpc error: code = NotFound desc = could not find container \"3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62\": container with ID starting with 3120f5257b732ca9fec606a0933a50a0c1cac72a1d225279920bad319d24ea62 not found: ID does not exist"
Jul 15 20:23:21.513438 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:21.513416    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"]
Jul 15 20:23:21.520173 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:21.520150    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7ac342b1-7778b4c7f5-h4gp4"]
Jul 15 20:23:22.895869 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:22.895839    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="492d5423-8b03-45bd-b20b-799e4c76a76b" path="/var/lib/kubelet/pods/492d5423-8b03-45bd-b20b-799e4c76a76b/volumes"
Jul 15 20:23:23.077480 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:23.077444    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:23:27.945193 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:27.945155    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"]
Jul 15 20:23:27.945688 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:27.945669    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd01f72c-640e-4b0c-b12c-0c00ab61d948" containerName="revoke-keys"
Jul 15 20:23:27.945765 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:27.945691    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd01f72c-640e-4b0c-b12c-0c00ab61d948" containerName="revoke-keys"
Jul 15 20:23:27.945765 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:27.945740    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="492d5423-8b03-45bd-b20b-799e4c76a76b" containerName="maas-api"
Jul 15 20:23:27.945765 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:27.945749    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="492d5423-8b03-45bd-b20b-799e4c76a76b" containerName="maas-api"
Jul 15 20:23:27.945916 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:27.945833    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="492d5423-8b03-45bd-b20b-799e4c76a76b" containerName="maas-api"
Jul 15 20:23:27.945916 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:27.945851    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd01f72c-640e-4b0c-b12c-0c00ab61d948" containerName="revoke-keys"
Jul 15 20:23:27.948746 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:27.948727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:27.951319 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:27.951295    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-dc00279d-serving-cert\""
Jul 15 20:23:27.963117 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:27.963091    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"]
Jul 15 20:23:28.048549 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:28.048519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gwcn\" (UniqueName: \"kubernetes.io/projected/b04ce6e1-807f-43da-ab01-77496f8b81e1-kube-api-access-4gwcn\") pod \"maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn\" (UID: \"b04ce6e1-807f-43da-ab01-77496f8b81e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:28.048711 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:28.048556    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b04ce6e1-807f-43da-ab01-77496f8b81e1-maas-api-tls\") pod \"maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn\" (UID: \"b04ce6e1-807f-43da-ab01-77496f8b81e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:28.048711 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:28.048622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04ce6e1-807f-43da-ab01-77496f8b81e1-openshift-service-ca\") pod \"maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn\" (UID: \"b04ce6e1-807f-43da-ab01-77496f8b81e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:28.149175 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:28.149136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gwcn\" (UniqueName: \"kubernetes.io/projected/b04ce6e1-807f-43da-ab01-77496f8b81e1-kube-api-access-4gwcn\") pod \"maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn\" (UID: \"b04ce6e1-807f-43da-ab01-77496f8b81e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:28.149175 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:28.149180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b04ce6e1-807f-43da-ab01-77496f8b81e1-maas-api-tls\") pod \"maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn\" (UID: \"b04ce6e1-807f-43da-ab01-77496f8b81e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:28.149414 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:28.149213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04ce6e1-807f-43da-ab01-77496f8b81e1-openshift-service-ca\") pod \"maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn\" (UID: \"b04ce6e1-807f-43da-ab01-77496f8b81e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:28.149791 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:28.149773    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04ce6e1-807f-43da-ab01-77496f8b81e1-openshift-service-ca\") pod \"maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn\" (UID: \"b04ce6e1-807f-43da-ab01-77496f8b81e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:28.151636 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:28.151618    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b04ce6e1-807f-43da-ab01-77496f8b81e1-maas-api-tls\") pod \"maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn\" (UID: \"b04ce6e1-807f-43da-ab01-77496f8b81e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:28.161207 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:28.161181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gwcn\" (UniqueName: \"kubernetes.io/projected/b04ce6e1-807f-43da-ab01-77496f8b81e1-kube-api-access-4gwcn\") pod \"maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn\" (UID: \"b04ce6e1-807f-43da-ab01-77496f8b81e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:28.258604 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:28.258522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:28.404967 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:28.404917    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"]
Jul 15 20:23:28.406340 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:23:28.406308    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04ce6e1_807f_43da_ab01_77496f8b81e1.slice/crio-a62c5da63b943d8588be1e58fb9fe2cba7a63fb4d896ca6242d504d7f4118468 WatchSource:0}: Error finding container a62c5da63b943d8588be1e58fb9fe2cba7a63fb4d896ca6242d504d7f4118468: Status 404 returned error can't find the container with id a62c5da63b943d8588be1e58fb9fe2cba7a63fb4d896ca6242d504d7f4118468
Jul 15 20:23:28.544914 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:28.544833    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn" event={"ID":"b04ce6e1-807f-43da-ab01-77496f8b81e1","Type":"ContainerStarted","Data":"a62c5da63b943d8588be1e58fb9fe2cba7a63fb4d896ca6242d504d7f4118468"}
Jul 15 20:23:29.552364 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:29.552330    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn" event={"ID":"b04ce6e1-807f-43da-ab01-77496f8b81e1","Type":"ContainerStarted","Data":"c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464"}
Jul 15 20:23:29.552753 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:29.552398    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:29.574063 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:29.574018    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn" podStartSLOduration=2.199696797 podStartE2EDuration="2.574005191s" totalImagesPullingTime="374.308394ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:23:29.572822069 +0000 UTC m=+1747.209939360" watchObservedRunningTime="2026-07-15 20:23:29.574005191 +0000 UTC m=+1747.211122480"
Jul 15 20:23:31.886796 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:31.886760    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:23:35.564630 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:35.564546    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:43.567234 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:43.567201    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"]
Jul 15 20:23:43.567650 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:43.567427    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn" podUID="b04ce6e1-807f-43da-ab01-77496f8b81e1" containerName="maas-api" containerID="cri-o://c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464" gracePeriod=30
Jul 15 20:23:43.831274 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:43.831218    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:43.886179 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:43.886149    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04ce6e1-807f-43da-ab01-77496f8b81e1-openshift-service-ca\") pod \"b04ce6e1-807f-43da-ab01-77496f8b81e1\" (UID: \"b04ce6e1-807f-43da-ab01-77496f8b81e1\") "
Jul 15 20:23:43.886343 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:43.886202    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b04ce6e1-807f-43da-ab01-77496f8b81e1-maas-api-tls\") pod \"b04ce6e1-807f-43da-ab01-77496f8b81e1\" (UID: \"b04ce6e1-807f-43da-ab01-77496f8b81e1\") "
Jul 15 20:23:43.886343 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:43.886312    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gwcn\" (UniqueName: \"kubernetes.io/projected/b04ce6e1-807f-43da-ab01-77496f8b81e1-kube-api-access-4gwcn\") pod \"b04ce6e1-807f-43da-ab01-77496f8b81e1\" (UID: \"b04ce6e1-807f-43da-ab01-77496f8b81e1\") "
Jul 15 20:23:43.886545 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:43.886516    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b04ce6e1-807f-43da-ab01-77496f8b81e1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b04ce6e1-807f-43da-ab01-77496f8b81e1" (UID: "b04ce6e1-807f-43da-ab01-77496f8b81e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:23:43.888454 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:43.888429    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b04ce6e1-807f-43da-ab01-77496f8b81e1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b04ce6e1-807f-43da-ab01-77496f8b81e1" (UID: "b04ce6e1-807f-43da-ab01-77496f8b81e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:23:43.888563 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:43.888506    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b04ce6e1-807f-43da-ab01-77496f8b81e1-kube-api-access-4gwcn" (OuterVolumeSpecName: "kube-api-access-4gwcn") pod "b04ce6e1-807f-43da-ab01-77496f8b81e1" (UID: "b04ce6e1-807f-43da-ab01-77496f8b81e1"). InnerVolumeSpecName "kube-api-access-4gwcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:23:43.987307 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:43.987259    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gwcn\" (UniqueName: \"kubernetes.io/projected/b04ce6e1-807f-43da-ab01-77496f8b81e1-kube-api-access-4gwcn\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:23:43.987307 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:43.987297    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04ce6e1-807f-43da-ab01-77496f8b81e1-openshift-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:23:43.987307 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:43.987307    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b04ce6e1-807f-43da-ab01-77496f8b81e1-maas-api-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:23:44.634351 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:44.634318    2560 generic.go:356] "Generic (PLEG): container finished" podID="b04ce6e1-807f-43da-ab01-77496f8b81e1" containerID="c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464" exitCode=0
Jul 15 20:23:44.634808 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:44.634364    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"
Jul 15 20:23:44.634808 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:44.634407    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn" event={"ID":"b04ce6e1-807f-43da-ab01-77496f8b81e1","Type":"ContainerDied","Data":"c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464"}
Jul 15 20:23:44.634808 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:44.634469    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn" event={"ID":"b04ce6e1-807f-43da-ab01-77496f8b81e1","Type":"ContainerDied","Data":"a62c5da63b943d8588be1e58fb9fe2cba7a63fb4d896ca6242d504d7f4118468"}
Jul 15 20:23:44.634808 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:44.634504    2560 scope.go:117] "RemoveContainer" containerID="c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464"
Jul 15 20:23:44.644255 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:44.644239    2560 scope.go:117] "RemoveContainer" containerID="c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464"
Jul 15 20:23:44.644506 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:23:44.644491    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464\": container with ID starting with c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464 not found: ID does not exist" containerID="c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464"
Jul 15 20:23:44.644557 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:44.644513    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464"} err="failed to get container status \"c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464\": rpc error: code = NotFound desc = could not find container \"c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464\": container with ID starting with c4b1f067d838490af095004405807a2dd16c1c0884936694c84fcaeeddb10464 not found: ID does not exist"
Jul 15 20:23:44.669104 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:44.669080    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"]
Jul 15 20:23:44.676441 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:44.676402    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc00279d-6cd44c8cd8-kwgqn"]
Jul 15 20:23:44.894813 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:44.894719    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b04ce6e1-807f-43da-ab01-77496f8b81e1" path="/var/lib/kubelet/pods/b04ce6e1-807f-43da-ab01-77496f8b81e1/volumes"
Jul 15 20:23:46.606485 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:23:46.606457    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:24:01.184905 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.184875    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"]
Jul 15 20:24:01.185315 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.185241    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04ce6e1-807f-43da-ab01-77496f8b81e1" containerName="maas-api"
Jul 15 20:24:01.185315 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.185253    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04ce6e1-807f-43da-ab01-77496f8b81e1" containerName="maas-api"
Jul 15 20:24:01.185390 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.185328    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04ce6e1-807f-43da-ab01-77496f8b81e1" containerName="maas-api"
Jul 15 20:24:01.188260 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.188244    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:01.193906 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.193883    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-85451227-serving-cert\""
Jul 15 20:24:01.204890 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.204865    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"]
Jul 15 20:24:01.340375 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.340340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-openshift-service-ca\") pod \"maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk\" (UID: \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:01.340555 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.340471    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-maas-api-tls\") pod \"maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk\" (UID: \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:01.340555 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.340524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfpkw\" (UniqueName: \"kubernetes.io/projected/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-kube-api-access-lfpkw\") pod \"maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk\" (UID: \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:01.441909 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.441823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-maas-api-tls\") pod \"maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk\" (UID: \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:01.441909 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.441885    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfpkw\" (UniqueName: \"kubernetes.io/projected/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-kube-api-access-lfpkw\") pod \"maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk\" (UID: \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:01.442140 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.441958    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-openshift-service-ca\") pod \"maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk\" (UID: \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:01.442580 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.442560    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-openshift-service-ca\") pod \"maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk\" (UID: \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:01.444468 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.444447    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-maas-api-tls\") pod \"maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk\" (UID: \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:01.453279 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.453246    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfpkw\" (UniqueName: \"kubernetes.io/projected/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-kube-api-access-lfpkw\") pod \"maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk\" (UID: \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:01.497810 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.497781    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:01.677523 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.677488    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"]
Jul 15 20:24:01.679781 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:24:01.679748    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ebb5d0_b8e4_4451_86a4_7e8d9ee6b86e.slice/crio-44d334d172534637f30fd6430a5ce9eeb7045cb92403289bf548e1a81a96d978 WatchSource:0}: Error finding container 44d334d172534637f30fd6430a5ce9eeb7045cb92403289bf548e1a81a96d978: Status 404 returned error can't find the container with id 44d334d172534637f30fd6430a5ce9eeb7045cb92403289bf548e1a81a96d978
Jul 15 20:24:01.725040 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:01.724960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk" event={"ID":"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e","Type":"ContainerStarted","Data":"44d334d172534637f30fd6430a5ce9eeb7045cb92403289bf548e1a81a96d978"}
Jul 15 20:24:02.731951 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:02.731898    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk" event={"ID":"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e","Type":"ContainerStarted","Data":"5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2"}
Jul 15 20:24:02.732414 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:02.731992    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:02.765643 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:02.765589    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk" podStartSLOduration=1.429770808 podStartE2EDuration="1.765574844s" totalImagesPullingTime="335.804036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:24:02.764513723 +0000 UTC m=+1780.401631015" watchObservedRunningTime="2026-07-15 20:24:02.765574844 +0000 UTC m=+1780.402692158"
Jul 15 20:24:06.728733 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:06.728703    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:24:08.744251 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:08.744223    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:24:22.883337 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:22.883311    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:24:22.888639 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:24:22.888621    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:25:06.101108 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:06.101076    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"]
Jul 15 20:25:06.103747 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:06.101258    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk" podUID="c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e" containerName="maas-api" containerID="cri-o://5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2" gracePeriod=30
Jul 15 20:25:06.362724 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:06.362626    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:25:06.486930 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:06.486899    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-maas-api-tls\") pod \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\" (UID: \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\") "
Jul 15 20:25:06.487110 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:06.486971    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-openshift-service-ca\") pod \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\" (UID: \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\") "
Jul 15 20:25:06.487110 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:06.486989    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfpkw\" (UniqueName: \"kubernetes.io/projected/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-kube-api-access-lfpkw\") pod \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\" (UID: \"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e\") "
Jul 15 20:25:06.487337 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:06.487309    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e" (UID: "c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:25:06.489173 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:06.489148    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e" (UID: "c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:25:06.489173 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:06.489154    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-kube-api-access-lfpkw" (OuterVolumeSpecName: "kube-api-access-lfpkw") pod "c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e" (UID: "c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e"). InnerVolumeSpecName "kube-api-access-lfpkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:25:06.587675 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:06.587644    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-maas-api-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:25:06.587675 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:06.587671    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-openshift-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:25:06.587835 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:06.587682    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfpkw\" (UniqueName: \"kubernetes.io/projected/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e-kube-api-access-lfpkw\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:25:07.077352 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:07.077316    2560 generic.go:356] "Generic (PLEG): container finished" podID="c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e" containerID="5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2" exitCode=0
Jul 15 20:25:07.077514 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:07.077373    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"
Jul 15 20:25:07.077514 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:07.077408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk" event={"ID":"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e","Type":"ContainerDied","Data":"5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2"}
Jul 15 20:25:07.077514 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:07.077466    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk" event={"ID":"c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e","Type":"ContainerDied","Data":"44d334d172534637f30fd6430a5ce9eeb7045cb92403289bf548e1a81a96d978"}
Jul 15 20:25:07.077514 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:07.077495    2560 scope.go:117] "RemoveContainer" containerID="5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2"
Jul 15 20:25:07.086532 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:07.086506    2560 scope.go:117] "RemoveContainer" containerID="5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2"
Jul 15 20:25:07.086756 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:25:07.086736    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2\": container with ID starting with 5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2 not found: ID does not exist" containerID="5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2"
Jul 15 20:25:07.086810 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:07.086770    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2"} err="failed to get container status \"5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2\": rpc error: code = NotFound desc = could not find container \"5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2\": container with ID starting with 5e5a15919e7e68eb81106848933bd702ad622f01d184aed00e603a8a5aa1aaa2 not found: ID does not exist"
Jul 15 20:25:07.102482 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:07.102458    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"]
Jul 15 20:25:07.104676 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:07.104652    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-85451227-5bd7f7bbb4-lwvzk"]
Jul 15 20:25:08.895322 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:08.895291    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e" path="/var/lib/kubelet/pods/c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e/volumes"
Jul 15 20:25:08.974435 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:25:08.974402    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:26:47.491080 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:26:47.491045    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:26:56.383310 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:26:56.383274    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:27:02.477675 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.477639    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"]
Jul 15 20:27:02.478136 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.478024    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e" containerName="maas-api"
Jul 15 20:27:02.478136 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.478036    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e" containerName="maas-api"
Jul 15 20:27:02.478136 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.478114    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9ebb5d0-b8e4-4451-86a4-7e8d9ee6b86e" containerName="maas-api"
Jul 15 20:27:02.481348 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.481331    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:02.486912 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.486886    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b8866fb3-serving-cert\""
Jul 15 20:27:02.501450 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.501425    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"]
Jul 15 20:27:02.548375 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.548336    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kltjs\" (UniqueName: \"kubernetes.io/projected/5527f81a-ea68-434f-ba7b-fe996111169b-kube-api-access-kltjs\") pod \"maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:02.548375 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.548382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5527f81a-ea68-434f-ba7b-fe996111169b-maas-api-tls\") pod \"maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:02.548628 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.548399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5527f81a-ea68-434f-ba7b-fe996111169b-openshift-service-ca\") pod \"maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:02.649147 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.649109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kltjs\" (UniqueName: \"kubernetes.io/projected/5527f81a-ea68-434f-ba7b-fe996111169b-kube-api-access-kltjs\") pod \"maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:02.649147 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.649153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5527f81a-ea68-434f-ba7b-fe996111169b-maas-api-tls\") pod \"maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:02.649479 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.649172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5527f81a-ea68-434f-ba7b-fe996111169b-openshift-service-ca\") pod \"maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:02.649479 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:27:02.649280    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-serving-cert: secret "maas-api-e2e-mt-b8866fb3-serving-cert" not found
Jul 15 20:27:02.649479 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:27:02.649370    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5527f81a-ea68-434f-ba7b-fe996111169b-maas-api-tls podName:5527f81a-ea68-434f-ba7b-fe996111169b nodeName:}" failed. No retries permitted until 2026-07-15 20:27:03.149348872 +0000 UTC m=+1960.786466146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5527f81a-ea68-434f-ba7b-fe996111169b-maas-api-tls") pod "maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl" (UID: "5527f81a-ea68-434f-ba7b-fe996111169b") : secret "maas-api-e2e-mt-b8866fb3-serving-cert" not found
Jul 15 20:27:02.649731 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.649714    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5527f81a-ea68-434f-ba7b-fe996111169b-openshift-service-ca\") pod \"maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:02.660218 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:02.660193    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kltjs\" (UniqueName: \"kubernetes.io/projected/5527f81a-ea68-434f-ba7b-fe996111169b-kube-api-access-kltjs\") pod \"maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:03.153342 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:03.153310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5527f81a-ea68-434f-ba7b-fe996111169b-maas-api-tls\") pod \"maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:03.155954 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:03.155905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5527f81a-ea68-434f-ba7b-fe996111169b-maas-api-tls\") pod \"maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:03.391759 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:03.391722    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:03.772367 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:03.772342    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"]
Jul 15 20:27:03.774408 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:27:03.774375    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5527f81a_ea68_434f_ba7b_fe996111169b.slice/crio-ccc10d25a92b9e84065f1f294f798fbc100793d7d0a3c68e3dac2b7281aa316e WatchSource:0}: Error finding container ccc10d25a92b9e84065f1f294f798fbc100793d7d0a3c68e3dac2b7281aa316e: Status 404 returned error can't find the container with id ccc10d25a92b9e84065f1f294f798fbc100793d7d0a3c68e3dac2b7281aa316e
Jul 15 20:27:03.775813 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:03.775792    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 20:27:04.687905 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:04.687870    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl" event={"ID":"5527f81a-ea68-434f-ba7b-fe996111169b","Type":"ContainerStarted","Data":"ccc10d25a92b9e84065f1f294f798fbc100793d7d0a3c68e3dac2b7281aa316e"}
Jul 15 20:27:05.694549 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:05.694513    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl" event={"ID":"5527f81a-ea68-434f-ba7b-fe996111169b","Type":"ContainerStarted","Data":"85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7"}
Jul 15 20:27:05.695001 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:05.694566    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:05.715050 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:05.714989    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl" podStartSLOduration=2.8408207819999998 podStartE2EDuration="3.714971319s" totalImagesPullingTime="874.150537ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:27:05.714332536 +0000 UTC m=+1963.351449826" watchObservedRunningTime="2026-07-15 20:27:05.714971319 +0000 UTC m=+1963.352088610"
Jul 15 20:27:10.080332 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:10.080297    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:27:11.705553 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:11.705524    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:25.402553 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.402463    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"]
Jul 15 20:27:25.403133 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.402737    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl" podUID="5527f81a-ea68-434f-ba7b-fe996111169b" containerName="maas-api" containerID="cri-o://85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7" gracePeriod=30
Jul 15 20:27:25.655600 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.655546    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:25.758153 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.758121    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5527f81a-ea68-434f-ba7b-fe996111169b-maas-api-tls\") pod \"5527f81a-ea68-434f-ba7b-fe996111169b\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") "
Jul 15 20:27:25.758350 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.758192    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5527f81a-ea68-434f-ba7b-fe996111169b-openshift-service-ca\") pod \"5527f81a-ea68-434f-ba7b-fe996111169b\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") "
Jul 15 20:27:25.758350 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.758227    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kltjs\" (UniqueName: \"kubernetes.io/projected/5527f81a-ea68-434f-ba7b-fe996111169b-kube-api-access-kltjs\") pod \"5527f81a-ea68-434f-ba7b-fe996111169b\" (UID: \"5527f81a-ea68-434f-ba7b-fe996111169b\") "
Jul 15 20:27:25.758513 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.758486    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5527f81a-ea68-434f-ba7b-fe996111169b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5527f81a-ea68-434f-ba7b-fe996111169b" (UID: "5527f81a-ea68-434f-ba7b-fe996111169b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:27:25.760398 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.760370    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5527f81a-ea68-434f-ba7b-fe996111169b-kube-api-access-kltjs" (OuterVolumeSpecName: "kube-api-access-kltjs") pod "5527f81a-ea68-434f-ba7b-fe996111169b" (UID: "5527f81a-ea68-434f-ba7b-fe996111169b"). InnerVolumeSpecName "kube-api-access-kltjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:27:25.760504 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.760490    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5527f81a-ea68-434f-ba7b-fe996111169b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5527f81a-ea68-434f-ba7b-fe996111169b" (UID: "5527f81a-ea68-434f-ba7b-fe996111169b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:27:25.802209 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.802183    2560 generic.go:356] "Generic (PLEG): container finished" podID="5527f81a-ea68-434f-ba7b-fe996111169b" containerID="85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7" exitCode=0
Jul 15 20:27:25.802313 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.802228    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"
Jul 15 20:27:25.802313 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.802268    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl" event={"ID":"5527f81a-ea68-434f-ba7b-fe996111169b","Type":"ContainerDied","Data":"85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7"}
Jul 15 20:27:25.802399 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.802326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl" event={"ID":"5527f81a-ea68-434f-ba7b-fe996111169b","Type":"ContainerDied","Data":"ccc10d25a92b9e84065f1f294f798fbc100793d7d0a3c68e3dac2b7281aa316e"}
Jul 15 20:27:25.802399 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.802356    2560 scope.go:117] "RemoveContainer" containerID="85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7"
Jul 15 20:27:25.811730 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.811714    2560 scope.go:117] "RemoveContainer" containerID="85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7"
Jul 15 20:27:25.812016 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:27:25.811993    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7\": container with ID starting with 85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7 not found: ID does not exist" containerID="85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7"
Jul 15 20:27:25.812087 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.812029    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7"} err="failed to get container status \"85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7\": rpc error: code = NotFound desc = could not find container \"85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7\": container with ID starting with 85290e2bc77ce9905141b41daab53ead9a5dc2778b9c61d8a17371d48becebc7 not found: ID does not exist"
Jul 15 20:27:25.826213 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.826185    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"]
Jul 15 20:27:25.832387 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.832368    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8866fb3-86c6f45ccc-kzzgl"]
Jul 15 20:27:25.859242 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.859223    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5527f81a-ea68-434f-ba7b-fe996111169b-maas-api-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:27:25.859242 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.859242    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5527f81a-ea68-434f-ba7b-fe996111169b-openshift-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:27:25.859355 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:25.859251    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kltjs\" (UniqueName: \"kubernetes.io/projected/5527f81a-ea68-434f-ba7b-fe996111169b-kube-api-access-kltjs\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:27:26.895297 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:26.895265    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5527f81a-ea68-434f-ba7b-fe996111169b" path="/var/lib/kubelet/pods/5527f81a-ea68-434f-ba7b-fe996111169b/volumes"
Jul 15 20:27:28.379447 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:27:28.379403    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:28:04.714614 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.714579    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"]
Jul 15 20:28:04.715097 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.714926    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5527f81a-ea68-434f-ba7b-fe996111169b" containerName="maas-api"
Jul 15 20:28:04.715097 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.714967    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5527f81a-ea68-434f-ba7b-fe996111169b" containerName="maas-api"
Jul 15 20:28:04.715097 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.715045    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5527f81a-ea68-434f-ba7b-fe996111169b" containerName="maas-api"
Jul 15 20:28:04.717915 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.717898    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:04.720741 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.720719    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-83c1a2fd-serving-cert\""
Jul 15 20:28:04.739783 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.739760    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"]
Jul 15 20:28:04.787303 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.787274    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5caf567e-bc13-4e72-bc07-89a317886936-maas-api-tls\") pod \"maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c\" (UID: \"5caf567e-bc13-4e72-bc07-89a317886936\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:04.787443 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.787319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5caf567e-bc13-4e72-bc07-89a317886936-openshift-service-ca\") pod \"maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c\" (UID: \"5caf567e-bc13-4e72-bc07-89a317886936\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:04.787443 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.787344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lczn9\" (UniqueName: \"kubernetes.io/projected/5caf567e-bc13-4e72-bc07-89a317886936-kube-api-access-lczn9\") pod \"maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c\" (UID: \"5caf567e-bc13-4e72-bc07-89a317886936\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:04.888720 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.888690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lczn9\" (UniqueName: \"kubernetes.io/projected/5caf567e-bc13-4e72-bc07-89a317886936-kube-api-access-lczn9\") pod \"maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c\" (UID: \"5caf567e-bc13-4e72-bc07-89a317886936\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:04.888888 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.888755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5caf567e-bc13-4e72-bc07-89a317886936-maas-api-tls\") pod \"maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c\" (UID: \"5caf567e-bc13-4e72-bc07-89a317886936\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:04.888888 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.888795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5caf567e-bc13-4e72-bc07-89a317886936-openshift-service-ca\") pod \"maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c\" (UID: \"5caf567e-bc13-4e72-bc07-89a317886936\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:04.889587 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.889563    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5caf567e-bc13-4e72-bc07-89a317886936-openshift-service-ca\") pod \"maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c\" (UID: \"5caf567e-bc13-4e72-bc07-89a317886936\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:04.891403 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.891382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5caf567e-bc13-4e72-bc07-89a317886936-maas-api-tls\") pod \"maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c\" (UID: \"5caf567e-bc13-4e72-bc07-89a317886936\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:04.898251 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:04.898225    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lczn9\" (UniqueName: \"kubernetes.io/projected/5caf567e-bc13-4e72-bc07-89a317886936-kube-api-access-lczn9\") pod \"maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c\" (UID: \"5caf567e-bc13-4e72-bc07-89a317886936\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:05.028216 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:05.028123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:05.176000 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:05.175976    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"]
Jul 15 20:28:05.178467 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:28:05.178441    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5caf567e_bc13_4e72_bc07_89a317886936.slice/crio-7537dba29e27cbc4b57c2fde6cd6325c9b4780765345a1049fd52165d10170e3 WatchSource:0}: Error finding container 7537dba29e27cbc4b57c2fde6cd6325c9b4780765345a1049fd52165d10170e3: Status 404 returned error can't find the container with id 7537dba29e27cbc4b57c2fde6cd6325c9b4780765345a1049fd52165d10170e3
Jul 15 20:28:06.009013 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:06.008978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c" event={"ID":"5caf567e-bc13-4e72-bc07-89a317886936","Type":"ContainerStarted","Data":"5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972"}
Jul 15 20:28:06.009414 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:06.009035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c" event={"ID":"5caf567e-bc13-4e72-bc07-89a317886936","Type":"ContainerStarted","Data":"7537dba29e27cbc4b57c2fde6cd6325c9b4780765345a1049fd52165d10170e3"}
Jul 15 20:28:06.009414 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:06.009183    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:06.038243 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:06.038199    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c" podStartSLOduration=1.628766133 podStartE2EDuration="2.038183226s" totalImagesPullingTime="409.417093ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:28:06.031771157 +0000 UTC m=+2023.668888444" watchObservedRunningTime="2026-07-15 20:28:06.038183226 +0000 UTC m=+2023.675300516"
Jul 15 20:28:09.490760 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:09.490731    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:28:12.020183 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:12.020149    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:21.204307 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:21.204270    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:28:36.393100 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:36.393067    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:28:53.446882 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:53.446851    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"]
Jul 15 20:28:53.447311 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:53.447070    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c" podUID="5caf567e-bc13-4e72-bc07-89a317886936" containerName="maas-api" containerID="cri-o://5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972" gracePeriod=30
Jul 15 20:28:53.691979 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:53.691957    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:53.788034 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:53.787931    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5caf567e-bc13-4e72-bc07-89a317886936-maas-api-tls\") pod \"5caf567e-bc13-4e72-bc07-89a317886936\" (UID: \"5caf567e-bc13-4e72-bc07-89a317886936\") "
Jul 15 20:28:53.788034 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:53.787997    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lczn9\" (UniqueName: \"kubernetes.io/projected/5caf567e-bc13-4e72-bc07-89a317886936-kube-api-access-lczn9\") pod \"5caf567e-bc13-4e72-bc07-89a317886936\" (UID: \"5caf567e-bc13-4e72-bc07-89a317886936\") "
Jul 15 20:28:53.788213 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:53.788094    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5caf567e-bc13-4e72-bc07-89a317886936-openshift-service-ca\") pod \"5caf567e-bc13-4e72-bc07-89a317886936\" (UID: \"5caf567e-bc13-4e72-bc07-89a317886936\") "
Jul 15 20:28:53.788420 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:53.788393    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5caf567e-bc13-4e72-bc07-89a317886936-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5caf567e-bc13-4e72-bc07-89a317886936" (UID: "5caf567e-bc13-4e72-bc07-89a317886936"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:28:53.790102 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:53.790075    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5caf567e-bc13-4e72-bc07-89a317886936-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5caf567e-bc13-4e72-bc07-89a317886936" (UID: "5caf567e-bc13-4e72-bc07-89a317886936"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:28:53.790190 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:53.790095    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5caf567e-bc13-4e72-bc07-89a317886936-kube-api-access-lczn9" (OuterVolumeSpecName: "kube-api-access-lczn9") pod "5caf567e-bc13-4e72-bc07-89a317886936" (UID: "5caf567e-bc13-4e72-bc07-89a317886936"). InnerVolumeSpecName "kube-api-access-lczn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:28:53.888765 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:53.888731    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5caf567e-bc13-4e72-bc07-89a317886936-maas-api-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:28:53.888765 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:53.888760    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lczn9\" (UniqueName: \"kubernetes.io/projected/5caf567e-bc13-4e72-bc07-89a317886936-kube-api-access-lczn9\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:28:53.888765 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:53.888769    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5caf567e-bc13-4e72-bc07-89a317886936-openshift-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:28:54.257159 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:54.257121    2560 generic.go:356] "Generic (PLEG): container finished" podID="5caf567e-bc13-4e72-bc07-89a317886936" containerID="5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972" exitCode=0
Jul 15 20:28:54.257403 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:54.257169    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"
Jul 15 20:28:54.257403 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:54.257204    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c" event={"ID":"5caf567e-bc13-4e72-bc07-89a317886936","Type":"ContainerDied","Data":"5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972"}
Jul 15 20:28:54.257403 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:54.257258    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c" event={"ID":"5caf567e-bc13-4e72-bc07-89a317886936","Type":"ContainerDied","Data":"7537dba29e27cbc4b57c2fde6cd6325c9b4780765345a1049fd52165d10170e3"}
Jul 15 20:28:54.257403 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:54.257279    2560 scope.go:117] "RemoveContainer" containerID="5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972"
Jul 15 20:28:54.267134 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:54.267118    2560 scope.go:117] "RemoveContainer" containerID="5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972"
Jul 15 20:28:54.267405 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:28:54.267386    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972\": container with ID starting with 5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972 not found: ID does not exist" containerID="5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972"
Jul 15 20:28:54.267465 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:54.267415    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972"} err="failed to get container status \"5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972\": rpc error: code = NotFound desc = could not find container \"5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972\": container with ID starting with 5409ab341d61e9fb24267d4f320686931fbff381c44f6ce6076972279cb35972 not found: ID does not exist"
Jul 15 20:28:54.283632 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:54.283593    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"]
Jul 15 20:28:54.287668 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:54.287650    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83c1a2fd-79cd7c65d-dn89c"]
Jul 15 20:28:54.894777 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:54.894734    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5caf567e-bc13-4e72-bc07-89a317886936" path="/var/lib/kubelet/pods/5caf567e-bc13-4e72-bc07-89a317886936/volumes"
Jul 15 20:28:57.004762 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:28:57.004722    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:29:22.916618 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:29:22.916593    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:29:22.927442 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:29:22.927421    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:29:53.791234 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:29:53.791200    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:30:07.778217 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:07.778183    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:30:49.733533 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.733501    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"]
Jul 15 20:30:49.734052 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.733901    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5caf567e-bc13-4e72-bc07-89a317886936" containerName="maas-api"
Jul 15 20:30:49.734052 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.733914    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5caf567e-bc13-4e72-bc07-89a317886936" containerName="maas-api"
Jul 15 20:30:49.734052 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.733998    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5caf567e-bc13-4e72-bc07-89a317886936" containerName="maas-api"
Jul 15 20:30:49.736951 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.736917    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:49.740329 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.740309    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-bec571-serving-cert\""
Jul 15 20:30:49.766779 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.766747    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"]
Jul 15 20:30:49.786686 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.786653    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv7hd\" (UniqueName: \"kubernetes.io/projected/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-kube-api-access-fv7hd\") pod \"maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:49.786840 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.786695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-maas-api-tls\") pod \"maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:49.786840 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.786775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:49.887801 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.887768    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-maas-api-tls\") pod \"maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:49.888036 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.887835    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:49.888036 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.887888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv7hd\" (UniqueName: \"kubernetes.io/projected/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-kube-api-access-fv7hd\") pod \"maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:49.888036 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:30:49.887929    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-serving-cert: secret "maas-api-e2e-inf-a-bec571-serving-cert" not found
Jul 15 20:30:49.888036 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:30:49.888034    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-maas-api-tls podName:0e3f0d1e-0e28-4cca-95c8-eb6777640c36 nodeName:}" failed. No retries permitted until 2026-07-15 20:30:50.388007173 +0000 UTC m=+2188.025124443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-maas-api-tls") pod "maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6" (UID: "0e3f0d1e-0e28-4cca-95c8-eb6777640c36") : secret "maas-api-e2e-inf-a-bec571-serving-cert" not found
Jul 15 20:30:49.888662 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.888637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:49.897000 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:49.896976    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv7hd\" (UniqueName: \"kubernetes.io/projected/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-kube-api-access-fv7hd\") pod \"maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:50.392893 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:50.392856    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-maas-api-tls\") pod \"maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:50.395469 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:50.395441    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-maas-api-tls\") pod \"maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:50.646993 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:50.646887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:50.794381 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:50.794356    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"]
Jul 15 20:30:50.796580 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:30:50.796542    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e3f0d1e_0e28_4cca_95c8_eb6777640c36.slice/crio-d0351b8aaefbe642ba313a1bc0250ed30ff8bc2fa628c3b33a9e0cefb2cbfaa9 WatchSource:0}: Error finding container d0351b8aaefbe642ba313a1bc0250ed30ff8bc2fa628c3b33a9e0cefb2cbfaa9: Status 404 returned error can't find the container with id d0351b8aaefbe642ba313a1bc0250ed30ff8bc2fa628c3b33a9e0cefb2cbfaa9
Jul 15 20:30:50.846072 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:50.846035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6" event={"ID":"0e3f0d1e-0e28-4cca-95c8-eb6777640c36","Type":"ContainerStarted","Data":"d0351b8aaefbe642ba313a1bc0250ed30ff8bc2fa628c3b33a9e0cefb2cbfaa9"}
Jul 15 20:30:51.853215 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:51.853179    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6" event={"ID":"0e3f0d1e-0e28-4cca-95c8-eb6777640c36","Type":"ContainerStarted","Data":"a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb"}
Jul 15 20:30:51.853606 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:51.853274    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:51.873436 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:51.873386    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6" podStartSLOduration=2.441929277 podStartE2EDuration="2.873371354s" totalImagesPullingTime="431.442077ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:30:51.871159499 +0000 UTC m=+2189.508276782" watchObservedRunningTime="2026-07-15 20:30:51.873371354 +0000 UTC m=+2189.510488644"
Jul 15 20:30:56.886169 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:56.886137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:30:57.649074 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.648996    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"]
Jul 15 20:30:57.652580 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.652564    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:30:57.655163 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.655136    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-4d97ce-serving-cert\""
Jul 15 20:30:57.677309 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.677283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"]
Jul 15 20:30:57.761650 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.761621    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5lk6\" (UniqueName: \"kubernetes.io/projected/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-kube-api-access-n5lk6\") pod \"maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk\" (UID: \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:30:57.761819 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.761656    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-maas-api-tls\") pod \"maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk\" (UID: \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:30:57.761819 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.761720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk\" (UID: \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:30:57.862463 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.862426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk\" (UID: \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:30:57.862640 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.862508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5lk6\" (UniqueName: \"kubernetes.io/projected/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-kube-api-access-n5lk6\") pod \"maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk\" (UID: \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:30:57.862640 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.862530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-maas-api-tls\") pod \"maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk\" (UID: \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:30:57.863141 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.863114    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk\" (UID: \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:30:57.865130 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.865108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-maas-api-tls\") pod \"maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk\" (UID: \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:30:57.865774 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.865758    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:30:57.872791 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.872768    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5lk6\" (UniqueName: \"kubernetes.io/projected/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-kube-api-access-n5lk6\") pod \"maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk\" (UID: \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:30:57.962491 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:57.962404    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:30:58.110907 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:58.110865    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"]
Jul 15 20:30:58.116548 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:30:58.116508    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc36782_7263_443c_aaaa_b4bfe5e1b8bf.slice/crio-7de0735eac8d611c073ce8db62f53fb9730b7bf3e7e282f83e0c40877016ab8b WatchSource:0}: Error finding container 7de0735eac8d611c073ce8db62f53fb9730b7bf3e7e282f83e0c40877016ab8b: Status 404 returned error can't find the container with id 7de0735eac8d611c073ce8db62f53fb9730b7bf3e7e282f83e0c40877016ab8b
Jul 15 20:30:58.894961 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:58.894911    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk" event={"ID":"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf","Type":"ContainerStarted","Data":"09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d"}
Jul 15 20:30:58.895109 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:58.894977    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:30:58.895109 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:58.894995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk" event={"ID":"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf","Type":"ContainerStarted","Data":"7de0735eac8d611c073ce8db62f53fb9730b7bf3e7e282f83e0c40877016ab8b"}
Jul 15 20:30:58.929311 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:30:58.929258    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk" podStartSLOduration=1.5212685270000001 podStartE2EDuration="1.9292426s" totalImagesPullingTime="407.974073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:30:58.927170348 +0000 UTC m=+2196.564287853" watchObservedRunningTime="2026-07-15 20:30:58.9292426 +0000 UTC m=+2196.566359930"
Jul 15 20:31:04.905060 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:31:04.905031    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:31:07.995717 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:31:07.995682    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:31:19.703897 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:31:19.703867    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:31:37.798762 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:31:37.798723    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:32:07.233092 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:07.233053    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2"]
Jul 15 20:32:07.237184 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:07.237165    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2"
Jul 15 20:32:07.240369 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:07.240344    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-grvfv\""
Jul 15 20:32:07.247629 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:07.247607    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2"]
Jul 15 20:32:07.266424 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:07.266395    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31ad2b99-7274-4110-b39b-e2c865d271ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2\" (UID: \"31ad2b99-7274-4110-b39b-e2c865d271ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2"
Jul 15 20:32:07.367433 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:07.367397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31ad2b99-7274-4110-b39b-e2c865d271ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2\" (UID: \"31ad2b99-7274-4110-b39b-e2c865d271ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2"
Jul 15 20:32:07.368081 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:07.368061    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31ad2b99-7274-4110-b39b-e2c865d271ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2\" (UID: \"31ad2b99-7274-4110-b39b-e2c865d271ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2"
Jul 15 20:32:07.548745 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:07.548644    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2"
Jul 15 20:32:07.700474 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:07.700444    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2"]
Jul 15 20:32:07.701786 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:32:07.701763    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ad2b99_7274_4110_b39b_e2c865d271ed.slice/crio-34961a3dffa309b1625c5fd7484144f3d1675c2dab96cec6bd7ad5de27cd305c WatchSource:0}: Error finding container 34961a3dffa309b1625c5fd7484144f3d1675c2dab96cec6bd7ad5de27cd305c: Status 404 returned error can't find the container with id 34961a3dffa309b1625c5fd7484144f3d1675c2dab96cec6bd7ad5de27cd305c
Jul 15 20:32:08.258273 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:08.258183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2" event={"ID":"31ad2b99-7274-4110-b39b-e2c865d271ed","Type":"ContainerStarted","Data":"47bbd2bf497f21b8319133568a14b1a7bf8ea4ac652423e91d51556cea78aae8"}
Jul 15 20:32:08.258273 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:08.258241    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2" event={"ID":"31ad2b99-7274-4110-b39b-e2c865d271ed","Type":"ContainerStarted","Data":"34961a3dffa309b1625c5fd7484144f3d1675c2dab96cec6bd7ad5de27cd305c"}
Jul 15 20:32:08.283016 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:08.282969    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2" podStartSLOduration=1.282929858 podStartE2EDuration="1.282929858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:32:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:32:08.280842976 +0000 UTC m=+2265.917960267" watchObservedRunningTime="2026-07-15 20:32:08.282929858 +0000 UTC m=+2265.920047147"
Jul 15 20:32:09.265013 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:09.264980    2560 generic.go:356] "Generic (PLEG): container finished" podID="31ad2b99-7274-4110-b39b-e2c865d271ed" containerID="47bbd2bf497f21b8319133568a14b1a7bf8ea4ac652423e91d51556cea78aae8" exitCode=0
Jul 15 20:32:09.265478 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:09.265072    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2" event={"ID":"31ad2b99-7274-4110-b39b-e2c865d271ed","Type":"ContainerDied","Data":"47bbd2bf497f21b8319133568a14b1a7bf8ea4ac652423e91d51556cea78aae8"}
Jul 15 20:32:10.407235 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:10.407211    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2"
Jul 15 20:32:10.495019 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:10.494988    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31ad2b99-7274-4110-b39b-e2c865d271ed-maas-api-service-ca\") pod \"31ad2b99-7274-4110-b39b-e2c865d271ed\" (UID: \"31ad2b99-7274-4110-b39b-e2c865d271ed\") "
Jul 15 20:32:10.495359 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:10.495335    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31ad2b99-7274-4110-b39b-e2c865d271ed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "31ad2b99-7274-4110-b39b-e2c865d271ed" (UID: "31ad2b99-7274-4110-b39b-e2c865d271ed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:32:10.596102 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:10.596079    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31ad2b99-7274-4110-b39b-e2c865d271ed-maas-api-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:32:11.276928 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:11.276848    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2"
Jul 15 20:32:11.276928 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:11.276862    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2" event={"ID":"31ad2b99-7274-4110-b39b-e2c865d271ed","Type":"ContainerDied","Data":"34961a3dffa309b1625c5fd7484144f3d1675c2dab96cec6bd7ad5de27cd305c"}
Jul 15 20:32:11.277128 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:11.276954    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34961a3dffa309b1625c5fd7484144f3d1675c2dab96cec6bd7ad5de27cd305c"
Jul 15 20:32:11.514686 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:11.514655    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:32:17.931639 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:17.931604    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"]
Jul 15 20:32:17.932532 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:17.932471    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6" podUID="0e3f0d1e-0e28-4cca-95c8-eb6777640c36" containerName="maas-api" containerID="cri-o://a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb" gracePeriod=30
Jul 15 20:32:18.175521 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.175496    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:32:18.264295 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.264194    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv7hd\" (UniqueName: \"kubernetes.io/projected/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-kube-api-access-fv7hd\") pod \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") "
Jul 15 20:32:18.264455 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.264307    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-openshift-service-ca\") pod \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") "
Jul 15 20:32:18.264455 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.264344    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-maas-api-tls\") pod \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\" (UID: \"0e3f0d1e-0e28-4cca-95c8-eb6777640c36\") "
Jul 15 20:32:18.264696 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.264670    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e3f0d1e-0e28-4cca-95c8-eb6777640c36" (UID: "0e3f0d1e-0e28-4cca-95c8-eb6777640c36"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:32:18.266519 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.266493    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e3f0d1e-0e28-4cca-95c8-eb6777640c36" (UID: "0e3f0d1e-0e28-4cca-95c8-eb6777640c36"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:32:18.266632 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.266533    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-kube-api-access-fv7hd" (OuterVolumeSpecName: "kube-api-access-fv7hd") pod "0e3f0d1e-0e28-4cca-95c8-eb6777640c36" (UID: "0e3f0d1e-0e28-4cca-95c8-eb6777640c36"). InnerVolumeSpecName "kube-api-access-fv7hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:32:18.315825 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.315793    2560 generic.go:356] "Generic (PLEG): container finished" podID="0e3f0d1e-0e28-4cca-95c8-eb6777640c36" containerID="a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb" exitCode=0
Jul 15 20:32:18.316067 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.315843    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"
Jul 15 20:32:18.316067 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.315883    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6" event={"ID":"0e3f0d1e-0e28-4cca-95c8-eb6777640c36","Type":"ContainerDied","Data":"a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb"}
Jul 15 20:32:18.316067 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.315966    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6" event={"ID":"0e3f0d1e-0e28-4cca-95c8-eb6777640c36","Type":"ContainerDied","Data":"d0351b8aaefbe642ba313a1bc0250ed30ff8bc2fa628c3b33a9e0cefb2cbfaa9"}
Jul 15 20:32:18.316067 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.315995    2560 scope.go:117] "RemoveContainer" containerID="a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb"
Jul 15 20:32:18.326230 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.326213    2560 scope.go:117] "RemoveContainer" containerID="a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb"
Jul 15 20:32:18.326505 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:32:18.326486    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb\": container with ID starting with a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb not found: ID does not exist" containerID="a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb"
Jul 15 20:32:18.326553 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.326516    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb"} err="failed to get container status \"a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb\": rpc error: code = NotFound desc = could not find container \"a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb\": container with ID starting with a895367ca3e840323d0fd3862bd03573713cdfdaa01e206294892b30bddae8cb not found: ID does not exist"
Jul 15 20:32:18.354204 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.354166    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"]
Jul 15 20:32:18.356267 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.356246    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bec571-5dcff4847f-m5kk6"]
Jul 15 20:32:18.365725 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.365700    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-openshift-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:32:18.365725 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.365722    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-maas-api-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:32:18.365840 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.365733    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv7hd\" (UniqueName: \"kubernetes.io/projected/0e3f0d1e-0e28-4cca-95c8-eb6777640c36-kube-api-access-fv7hd\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:32:18.895858 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:18.895821    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e3f0d1e-0e28-4cca-95c8-eb6777640c36" path="/var/lib/kubelet/pods/0e3f0d1e-0e28-4cca-95c8-eb6777640c36/volumes"
Jul 15 20:32:27.674893 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:27.674858    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:32:44.049552 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.049509    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"]
Jul 15 20:32:44.050166 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.049773    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk" podUID="2cc36782-7263-443c-aaaa-b4bfe5e1b8bf" containerName="maas-api" containerID="cri-o://09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d" gracePeriod=30
Jul 15 20:32:44.306612 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.306555    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:32:44.457335 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.457296    2560 generic.go:356] "Generic (PLEG): container finished" podID="2cc36782-7263-443c-aaaa-b4bfe5e1b8bf" containerID="09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d" exitCode=0
Jul 15 20:32:44.457512 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.457353    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"
Jul 15 20:32:44.457512 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.457440    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk" event={"ID":"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf","Type":"ContainerDied","Data":"09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d"}
Jul 15 20:32:44.457603 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.457541    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk" event={"ID":"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf","Type":"ContainerDied","Data":"7de0735eac8d611c073ce8db62f53fb9730b7bf3e7e282f83e0c40877016ab8b"}
Jul 15 20:32:44.457603 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.457567    2560 scope.go:117] "RemoveContainer" containerID="09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d"
Jul 15 20:32:44.468685 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.468664    2560 scope.go:117] "RemoveContainer" containerID="09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d"
Jul 15 20:32:44.468971 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:32:44.468951    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d\": container with ID starting with 09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d not found: ID does not exist" containerID="09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d"
Jul 15 20:32:44.469024 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.468982    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d"} err="failed to get container status \"09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d\": rpc error: code = NotFound desc = could not find container \"09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d\": container with ID starting with 09236749dc6f99e361c1a9ad5cae77557a013b8c3a39a181ff2fae177fd1433d not found: ID does not exist"
Jul 15 20:32:44.499721 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.499689    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-openshift-service-ca\") pod \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\" (UID: \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\") "
Jul 15 20:32:44.499870 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.499730    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5lk6\" (UniqueName: \"kubernetes.io/projected/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-kube-api-access-n5lk6\") pod \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\" (UID: \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\") "
Jul 15 20:32:44.499870 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.499772    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-maas-api-tls\") pod \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\" (UID: \"2cc36782-7263-443c-aaaa-b4bfe5e1b8bf\") "
Jul 15 20:32:44.500036 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.499983    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2cc36782-7263-443c-aaaa-b4bfe5e1b8bf" (UID: "2cc36782-7263-443c-aaaa-b4bfe5e1b8bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:32:44.500112 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.500094    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-openshift-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:32:44.501876 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.501854    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-kube-api-access-n5lk6" (OuterVolumeSpecName: "kube-api-access-n5lk6") pod "2cc36782-7263-443c-aaaa-b4bfe5e1b8bf" (UID: "2cc36782-7263-443c-aaaa-b4bfe5e1b8bf"). InnerVolumeSpecName "kube-api-access-n5lk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:32:44.502015 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.501910    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2cc36782-7263-443c-aaaa-b4bfe5e1b8bf" (UID: "2cc36782-7263-443c-aaaa-b4bfe5e1b8bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:32:44.601043 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.601016    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5lk6\" (UniqueName: \"kubernetes.io/projected/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-kube-api-access-n5lk6\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:32:44.601208 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.601047    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf-maas-api-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:32:44.778903 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.778870    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"]
Jul 15 20:32:44.782988 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.782963    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4d97ce-6f9bdcf95c-7s2jk"]
Jul 15 20:32:44.895411 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:44.895334    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cc36782-7263-443c-aaaa-b4bfe5e1b8bf" path="/var/lib/kubelet/pods/2cc36782-7263-443c-aaaa-b4bfe5e1b8bf/volumes"
Jul 15 20:32:47.526959 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:32:47.526900    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:33:03.613827 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.613793    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"]
Jul 15 20:33:03.614276 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.614174    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ad2b99-7274-4110-b39b-e2c865d271ed" containerName="revoke-keys"
Jul 15 20:33:03.614276 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.614186    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ad2b99-7274-4110-b39b-e2c865d271ed" containerName="revoke-keys"
Jul 15 20:33:03.614276 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.614195    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e3f0d1e-0e28-4cca-95c8-eb6777640c36" containerName="maas-api"
Jul 15 20:33:03.614276 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.614200    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e3f0d1e-0e28-4cca-95c8-eb6777640c36" containerName="maas-api"
Jul 15 20:33:03.614276 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.614213    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cc36782-7263-443c-aaaa-b4bfe5e1b8bf" containerName="maas-api"
Jul 15 20:33:03.614276 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.614219    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cc36782-7263-443c-aaaa-b4bfe5e1b8bf" containerName="maas-api"
Jul 15 20:33:03.614486 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.614299    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cc36782-7263-443c-aaaa-b4bfe5e1b8bf" containerName="maas-api"
Jul 15 20:33:03.614486 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.614314    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e3f0d1e-0e28-4cca-95c8-eb6777640c36" containerName="maas-api"
Jul 15 20:33:03.614486 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.614323    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ad2b99-7274-4110-b39b-e2c865d271ed" containerName="revoke-keys"
Jul 15 20:33:03.617141 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.617124    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:03.620441 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.620417    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-514f9c-serving-cert\""
Jul 15 20:33:03.630536 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.630513    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"]
Jul 15 20:33:03.651681 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.651649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3966220f-e4a0-43f4-8aaf-98329bd5ed71-openshift-service-ca\") pod \"maas-api-e2e-api-a-514f9c-78c484cc5-gr65k\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:03.651805 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.651688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3966220f-e4a0-43f4-8aaf-98329bd5ed71-maas-api-tls\") pod \"maas-api-e2e-api-a-514f9c-78c484cc5-gr65k\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:03.651805 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.651726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhlkm\" (UniqueName: \"kubernetes.io/projected/3966220f-e4a0-43f4-8aaf-98329bd5ed71-kube-api-access-bhlkm\") pod \"maas-api-e2e-api-a-514f9c-78c484cc5-gr65k\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:03.752839 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.752804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3966220f-e4a0-43f4-8aaf-98329bd5ed71-openshift-service-ca\") pod \"maas-api-e2e-api-a-514f9c-78c484cc5-gr65k\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:03.753041 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.752845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3966220f-e4a0-43f4-8aaf-98329bd5ed71-maas-api-tls\") pod \"maas-api-e2e-api-a-514f9c-78c484cc5-gr65k\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:03.753041 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.752892    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhlkm\" (UniqueName: \"kubernetes.io/projected/3966220f-e4a0-43f4-8aaf-98329bd5ed71-kube-api-access-bhlkm\") pod \"maas-api-e2e-api-a-514f9c-78c484cc5-gr65k\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:03.753167 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:33:03.753057    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-serving-cert: secret "maas-api-e2e-api-a-514f9c-serving-cert" not found
Jul 15 20:33:03.753167 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:33:03.753139    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3966220f-e4a0-43f4-8aaf-98329bd5ed71-maas-api-tls podName:3966220f-e4a0-43f4-8aaf-98329bd5ed71 nodeName:}" failed. No retries permitted until 2026-07-15 20:33:04.253117825 +0000 UTC m=+2321.890235109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3966220f-e4a0-43f4-8aaf-98329bd5ed71-maas-api-tls") pod "maas-api-e2e-api-a-514f9c-78c484cc5-gr65k" (UID: "3966220f-e4a0-43f4-8aaf-98329bd5ed71") : secret "maas-api-e2e-api-a-514f9c-serving-cert" not found
Jul 15 20:33:03.753704 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.753682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3966220f-e4a0-43f4-8aaf-98329bd5ed71-openshift-service-ca\") pod \"maas-api-e2e-api-a-514f9c-78c484cc5-gr65k\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:03.765858 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:03.765836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhlkm\" (UniqueName: \"kubernetes.io/projected/3966220f-e4a0-43f4-8aaf-98329bd5ed71-kube-api-access-bhlkm\") pod \"maas-api-e2e-api-a-514f9c-78c484cc5-gr65k\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:04.257402 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:04.257358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3966220f-e4a0-43f4-8aaf-98329bd5ed71-maas-api-tls\") pod \"maas-api-e2e-api-a-514f9c-78c484cc5-gr65k\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:04.260082 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:04.260063    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3966220f-e4a0-43f4-8aaf-98329bd5ed71-maas-api-tls\") pod \"maas-api-e2e-api-a-514f9c-78c484cc5-gr65k\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:04.526856 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:04.526779    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:04.674160 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:04.674137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"]
Jul 15 20:33:04.676878 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:33:04.676850    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3966220f_e4a0_43f4_8aaf_98329bd5ed71.slice/crio-a55a5f1ecfc8a02422589fe7b220ba83f30dabf2755aa62ca1910af5f81da4a6 WatchSource:0}: Error finding container a55a5f1ecfc8a02422589fe7b220ba83f30dabf2755aa62ca1910af5f81da4a6: Status 404 returned error can't find the container with id a55a5f1ecfc8a02422589fe7b220ba83f30dabf2755aa62ca1910af5f81da4a6
Jul 15 20:33:04.678547 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:04.678530    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 20:33:05.565577 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:05.565470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k" event={"ID":"3966220f-e4a0-43f4-8aaf-98329bd5ed71","Type":"ContainerStarted","Data":"f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da"}
Jul 15 20:33:05.565577 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:05.565537    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k" event={"ID":"3966220f-e4a0-43f4-8aaf-98329bd5ed71","Type":"ContainerStarted","Data":"a55a5f1ecfc8a02422589fe7b220ba83f30dabf2755aa62ca1910af5f81da4a6"}
Jul 15 20:33:05.565577 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:05.565563    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:05.586049 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:05.585997    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k" podStartSLOduration=2.140136969 podStartE2EDuration="2.585982499s" totalImagesPullingTime="445.84553ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:33:05.584867006 +0000 UTC m=+2323.221984333" watchObservedRunningTime="2026-07-15 20:33:05.585982499 +0000 UTC m=+2323.223099788"
Jul 15 20:33:08.191774 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:08.191734    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:33:11.576759 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:11.576730    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:12.573684 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:12.573649    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"]
Jul 15 20:33:12.577916 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:12.577887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:12.580360 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:12.580341    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-76c4bb-serving-cert\""
Jul 15 20:33:12.587647 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:12.587623    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"]
Jul 15 20:33:12.637090 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:12.637058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5da08cd-52fd-4587-b8c0-7c99023a7889-openshift-service-ca\") pod \"maas-api-e2e-api-b-76c4bb-6878b68646-5gb54\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:12.637249 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:12.637145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62tqw\" (UniqueName: \"kubernetes.io/projected/c5da08cd-52fd-4587-b8c0-7c99023a7889-kube-api-access-62tqw\") pod \"maas-api-e2e-api-b-76c4bb-6878b68646-5gb54\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:12.637249 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:12.637171    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5da08cd-52fd-4587-b8c0-7c99023a7889-maas-api-tls\") pod \"maas-api-e2e-api-b-76c4bb-6878b68646-5gb54\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:12.737859 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:12.737826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62tqw\" (UniqueName: \"kubernetes.io/projected/c5da08cd-52fd-4587-b8c0-7c99023a7889-kube-api-access-62tqw\") pod \"maas-api-e2e-api-b-76c4bb-6878b68646-5gb54\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:12.737859 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:12.737862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5da08cd-52fd-4587-b8c0-7c99023a7889-maas-api-tls\") pod \"maas-api-e2e-api-b-76c4bb-6878b68646-5gb54\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:12.738068 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:12.737899    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5da08cd-52fd-4587-b8c0-7c99023a7889-openshift-service-ca\") pod \"maas-api-e2e-api-b-76c4bb-6878b68646-5gb54\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:12.738068 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:33:12.738025    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-serving-cert: secret "maas-api-e2e-api-b-76c4bb-serving-cert" not found
Jul 15 20:33:12.738141 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:33:12.738102    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5da08cd-52fd-4587-b8c0-7c99023a7889-maas-api-tls podName:c5da08cd-52fd-4587-b8c0-7c99023a7889 nodeName:}" failed. No retries permitted until 2026-07-15 20:33:13.23808341 +0000 UTC m=+2330.875200693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c5da08cd-52fd-4587-b8c0-7c99023a7889-maas-api-tls") pod "maas-api-e2e-api-b-76c4bb-6878b68646-5gb54" (UID: "c5da08cd-52fd-4587-b8c0-7c99023a7889") : secret "maas-api-e2e-api-b-76c4bb-serving-cert" not found
Jul 15 20:33:12.738478 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:12.738461    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5da08cd-52fd-4587-b8c0-7c99023a7889-openshift-service-ca\") pod \"maas-api-e2e-api-b-76c4bb-6878b68646-5gb54\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:12.752092 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:12.752072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62tqw\" (UniqueName: \"kubernetes.io/projected/c5da08cd-52fd-4587-b8c0-7c99023a7889-kube-api-access-62tqw\") pod \"maas-api-e2e-api-b-76c4bb-6878b68646-5gb54\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:13.242746 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:13.242716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5da08cd-52fd-4587-b8c0-7c99023a7889-maas-api-tls\") pod \"maas-api-e2e-api-b-76c4bb-6878b68646-5gb54\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:13.242926 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:33:13.242866    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-serving-cert: secret "maas-api-e2e-api-b-76c4bb-serving-cert" not found
Jul 15 20:33:13.242991 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:33:13.242969    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5da08cd-52fd-4587-b8c0-7c99023a7889-maas-api-tls podName:c5da08cd-52fd-4587-b8c0-7c99023a7889 nodeName:}" failed. No retries permitted until 2026-07-15 20:33:14.242954629 +0000 UTC m=+2331.880071909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c5da08cd-52fd-4587-b8c0-7c99023a7889-maas-api-tls") pod "maas-api-e2e-api-b-76c4bb-6878b68646-5gb54" (UID: "c5da08cd-52fd-4587-b8c0-7c99023a7889") : secret "maas-api-e2e-api-b-76c4bb-serving-cert" not found
Jul 15 20:33:14.251321 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:14.251286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5da08cd-52fd-4587-b8c0-7c99023a7889-maas-api-tls\") pod \"maas-api-e2e-api-b-76c4bb-6878b68646-5gb54\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:14.253760 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:14.253739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5da08cd-52fd-4587-b8c0-7c99023a7889-maas-api-tls\") pod \"maas-api-e2e-api-b-76c4bb-6878b68646-5gb54\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:14.389827 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:14.389795    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:14.544084 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:14.544060    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"]
Jul 15 20:33:14.545892 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:33:14.545869    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5da08cd_52fd_4587_b8c0_7c99023a7889.slice/crio-51843b564a16073f494f93b880172a1fbf497d33dd2eae998611243746597439 WatchSource:0}: Error finding container 51843b564a16073f494f93b880172a1fbf497d33dd2eae998611243746597439: Status 404 returned error can't find the container with id 51843b564a16073f494f93b880172a1fbf497d33dd2eae998611243746597439
Jul 15 20:33:14.617674 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:14.617636    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54" event={"ID":"c5da08cd-52fd-4587-b8c0-7c99023a7889","Type":"ContainerStarted","Data":"51843b564a16073f494f93b880172a1fbf497d33dd2eae998611243746597439"}
Jul 15 20:33:15.625906 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:15.625865    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54" event={"ID":"c5da08cd-52fd-4587-b8c0-7c99023a7889","Type":"ContainerStarted","Data":"d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2"}
Jul 15 20:33:15.626324 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:15.626082    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:15.653095 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:15.653048    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54" podStartSLOduration=3.351337716 podStartE2EDuration="3.653033593s" totalImagesPullingTime="301.695877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:33:15.650544298 +0000 UTC m=+2333.287661588" watchObservedRunningTime="2026-07-15 20:33:15.653033593 +0000 UTC m=+2333.290150897"
Jul 15 20:33:20.283339 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:20.283301    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:33:21.638640 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:21.638605    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:33:36.716979 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:36.716924    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"]
Jul 15 20:33:36.717364 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:36.717169    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k" podUID="3966220f-e4a0-43f4-8aaf-98329bd5ed71" containerName="maas-api" containerID="cri-o://f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da" gracePeriod=30
Jul 15 20:33:36.961105 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:36.961078    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:37.158156 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.158120    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3966220f-e4a0-43f4-8aaf-98329bd5ed71-maas-api-tls\") pod \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") "
Jul 15 20:33:37.158324 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.158172    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3966220f-e4a0-43f4-8aaf-98329bd5ed71-openshift-service-ca\") pod \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") "
Jul 15 20:33:37.158324 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.158244    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhlkm\" (UniqueName: \"kubernetes.io/projected/3966220f-e4a0-43f4-8aaf-98329bd5ed71-kube-api-access-bhlkm\") pod \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\" (UID: \"3966220f-e4a0-43f4-8aaf-98329bd5ed71\") "
Jul 15 20:33:37.158545 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.158520    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3966220f-e4a0-43f4-8aaf-98329bd5ed71-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3966220f-e4a0-43f4-8aaf-98329bd5ed71" (UID: "3966220f-e4a0-43f4-8aaf-98329bd5ed71"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:33:37.160457 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.160422    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3966220f-e4a0-43f4-8aaf-98329bd5ed71-kube-api-access-bhlkm" (OuterVolumeSpecName: "kube-api-access-bhlkm") pod "3966220f-e4a0-43f4-8aaf-98329bd5ed71" (UID: "3966220f-e4a0-43f4-8aaf-98329bd5ed71"). InnerVolumeSpecName "kube-api-access-bhlkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:33:37.160565 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.160452    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3966220f-e4a0-43f4-8aaf-98329bd5ed71-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3966220f-e4a0-43f4-8aaf-98329bd5ed71" (UID: "3966220f-e4a0-43f4-8aaf-98329bd5ed71"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:33:37.259104 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.259072    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhlkm\" (UniqueName: \"kubernetes.io/projected/3966220f-e4a0-43f4-8aaf-98329bd5ed71-kube-api-access-bhlkm\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:33:37.259104 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.259099    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3966220f-e4a0-43f4-8aaf-98329bd5ed71-maas-api-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:33:37.259279 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.259113    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3966220f-e4a0-43f4-8aaf-98329bd5ed71-openshift-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:33:37.747794 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.747762    2560 generic.go:356] "Generic (PLEG): container finished" podID="3966220f-e4a0-43f4-8aaf-98329bd5ed71" containerID="f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da" exitCode=0
Jul 15 20:33:37.748226 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.747806    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"
Jul 15 20:33:37.748226 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.747854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k" event={"ID":"3966220f-e4a0-43f4-8aaf-98329bd5ed71","Type":"ContainerDied","Data":"f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da"}
Jul 15 20:33:37.748226 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.747908    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k" event={"ID":"3966220f-e4a0-43f4-8aaf-98329bd5ed71","Type":"ContainerDied","Data":"a55a5f1ecfc8a02422589fe7b220ba83f30dabf2755aa62ca1910af5f81da4a6"}
Jul 15 20:33:37.748226 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.747930    2560 scope.go:117] "RemoveContainer" containerID="f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da"
Jul 15 20:33:37.757310 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.757296    2560 scope.go:117] "RemoveContainer" containerID="f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da"
Jul 15 20:33:37.757558 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:33:37.757541    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da\": container with ID starting with f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da not found: ID does not exist" containerID="f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da"
Jul 15 20:33:37.757606 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.757566    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da"} err="failed to get container status \"f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da\": rpc error: code = NotFound desc = could not find container \"f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da\": container with ID starting with f08bc5940bd088908ea43a1d827acf333d2aa37421d4e45dce2f83ecb1f2b4da not found: ID does not exist"
Jul 15 20:33:37.770065 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.770043    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"]
Jul 15 20:33:37.774051 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:37.774028    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-514f9c-78c484cc5-gr65k"]
Jul 15 20:33:38.894586 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:38.894554    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3966220f-e4a0-43f4-8aaf-98329bd5ed71" path="/var/lib/kubelet/pods/3966220f-e4a0-43f4-8aaf-98329bd5ed71/volumes"
Jul 15 20:33:39.983288 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:33:39.983255    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:34:03.980250 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:03.980215    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"]
Jul 15 20:34:03.981051 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:03.980396    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54" podUID="c5da08cd-52fd-4587-b8c0-7c99023a7889" containerName="maas-api" containerID="cri-o://d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2" gracePeriod=30
Jul 15 20:34:04.235665 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.235605    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:34:04.275586 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.275558    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5da08cd-52fd-4587-b8c0-7c99023a7889-maas-api-tls\") pod \"c5da08cd-52fd-4587-b8c0-7c99023a7889\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") "
Jul 15 20:34:04.275734 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.275625    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62tqw\" (UniqueName: \"kubernetes.io/projected/c5da08cd-52fd-4587-b8c0-7c99023a7889-kube-api-access-62tqw\") pod \"c5da08cd-52fd-4587-b8c0-7c99023a7889\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") "
Jul 15 20:34:04.275734 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.275650    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5da08cd-52fd-4587-b8c0-7c99023a7889-openshift-service-ca\") pod \"c5da08cd-52fd-4587-b8c0-7c99023a7889\" (UID: \"c5da08cd-52fd-4587-b8c0-7c99023a7889\") "
Jul 15 20:34:04.276090 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.276066    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5da08cd-52fd-4587-b8c0-7c99023a7889-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c5da08cd-52fd-4587-b8c0-7c99023a7889" (UID: "c5da08cd-52fd-4587-b8c0-7c99023a7889"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:34:04.277652 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.277629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5da08cd-52fd-4587-b8c0-7c99023a7889-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c5da08cd-52fd-4587-b8c0-7c99023a7889" (UID: "c5da08cd-52fd-4587-b8c0-7c99023a7889"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:34:04.277760 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.277739    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5da08cd-52fd-4587-b8c0-7c99023a7889-kube-api-access-62tqw" (OuterVolumeSpecName: "kube-api-access-62tqw") pod "c5da08cd-52fd-4587-b8c0-7c99023a7889" (UID: "c5da08cd-52fd-4587-b8c0-7c99023a7889"). InnerVolumeSpecName "kube-api-access-62tqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:34:04.377087 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.377055    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5da08cd-52fd-4587-b8c0-7c99023a7889-maas-api-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:34:04.377087 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.377082    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62tqw\" (UniqueName: \"kubernetes.io/projected/c5da08cd-52fd-4587-b8c0-7c99023a7889-kube-api-access-62tqw\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:34:04.377256 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.377099    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5da08cd-52fd-4587-b8c0-7c99023a7889-openshift-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:34:04.893217 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.893185    2560 generic.go:356] "Generic (PLEG): container finished" podID="c5da08cd-52fd-4587-b8c0-7c99023a7889" containerID="d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2" exitCode=0
Jul 15 20:34:04.893391 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.893303    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"
Jul 15 20:34:04.894864 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.894836    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54" event={"ID":"c5da08cd-52fd-4587-b8c0-7c99023a7889","Type":"ContainerDied","Data":"d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2"}
Jul 15 20:34:04.895016 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.894877    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54" event={"ID":"c5da08cd-52fd-4587-b8c0-7c99023a7889","Type":"ContainerDied","Data":"51843b564a16073f494f93b880172a1fbf497d33dd2eae998611243746597439"}
Jul 15 20:34:04.895016 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.894905    2560 scope.go:117] "RemoveContainer" containerID="d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2"
Jul 15 20:34:04.906852 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.906832    2560 scope.go:117] "RemoveContainer" containerID="d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2"
Jul 15 20:34:04.907144 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:34:04.907127    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2\": container with ID starting with d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2 not found: ID does not exist" containerID="d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2"
Jul 15 20:34:04.907203 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.907153    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2"} err="failed to get container status \"d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2\": rpc error: code = NotFound desc = could not find container \"d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2\": container with ID starting with d7d3720ad3d10762a90ae8b18ae82ba6be185ffb114433a47cd46254acdbe7f2 not found: ID does not exist"
Jul 15 20:34:04.947267 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.947240    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"]
Jul 15 20:34:04.961885 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:04.961853    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-76c4bb-6878b68646-5gb54"]
Jul 15 20:34:06.895139 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:06.895104    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5da08cd-52fd-4587-b8c0-7c99023a7889" path="/var/lib/kubelet/pods/c5da08cd-52fd-4587-b8c0-7c99023a7889/volumes"
Jul 15 20:34:07.181173 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:07.181084    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:34:22.953096 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:22.953071    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:34:22.963088 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:22.963064    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:34:22.969735 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:22.969709    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"]
Jul 15 20:34:22.970104 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:22.970090    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5da08cd-52fd-4587-b8c0-7c99023a7889" containerName="maas-api"
Jul 15 20:34:22.970169 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:22.970108    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5da08cd-52fd-4587-b8c0-7c99023a7889" containerName="maas-api"
Jul 15 20:34:22.970169 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:22.970129    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3966220f-e4a0-43f4-8aaf-98329bd5ed71" containerName="maas-api"
Jul 15 20:34:22.970169 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:22.970136    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3966220f-e4a0-43f4-8aaf-98329bd5ed71" containerName="maas-api"
Jul 15 20:34:22.970273 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:22.970203    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5da08cd-52fd-4587-b8c0-7c99023a7889" containerName="maas-api"
Jul 15 20:34:22.970273 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:22.970211    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3966220f-e4a0-43f4-8aaf-98329bd5ed71" containerName="maas-api"
Jul 15 20:34:22.973224 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:22.973205    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:22.975656 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:22.975640    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-c4ecb2-serving-cert\""
Jul 15 20:34:22.995342 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:22.995320    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"]
Jul 15 20:34:23.142310 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.142282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq7mf\" (UniqueName: \"kubernetes.io/projected/6c0f9d84-59af-4e82-bf54-b18684952041-kube-api-access-dq7mf\") pod \"maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk\" (UID: \"6c0f9d84-59af-4e82-bf54-b18684952041\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:23.142443 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.142312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0f9d84-59af-4e82-bf54-b18684952041-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk\" (UID: \"6c0f9d84-59af-4e82-bf54-b18684952041\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:23.142443 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.142351    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c0f9d84-59af-4e82-bf54-b18684952041-maas-api-tls\") pod \"maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk\" (UID: \"6c0f9d84-59af-4e82-bf54-b18684952041\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:23.243168 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.243079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq7mf\" (UniqueName: \"kubernetes.io/projected/6c0f9d84-59af-4e82-bf54-b18684952041-kube-api-access-dq7mf\") pod \"maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk\" (UID: \"6c0f9d84-59af-4e82-bf54-b18684952041\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:23.243168 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.243112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0f9d84-59af-4e82-bf54-b18684952041-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk\" (UID: \"6c0f9d84-59af-4e82-bf54-b18684952041\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:23.243168 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.243153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c0f9d84-59af-4e82-bf54-b18684952041-maas-api-tls\") pod \"maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk\" (UID: \"6c0f9d84-59af-4e82-bf54-b18684952041\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:23.243784 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.243758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0f9d84-59af-4e82-bf54-b18684952041-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk\" (UID: \"6c0f9d84-59af-4e82-bf54-b18684952041\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:23.245766 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.245749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c0f9d84-59af-4e82-bf54-b18684952041-maas-api-tls\") pod \"maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk\" (UID: \"6c0f9d84-59af-4e82-bf54-b18684952041\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:23.251722 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.251697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq7mf\" (UniqueName: \"kubernetes.io/projected/6c0f9d84-59af-4e82-bf54-b18684952041-kube-api-access-dq7mf\") pod \"maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk\" (UID: \"6c0f9d84-59af-4e82-bf54-b18684952041\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:23.285911 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.285888    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:23.443418 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.443394    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"]
Jul 15 20:34:23.445448 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:34:23.445424    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0f9d84_59af_4e82_bf54_b18684952041.slice/crio-595c648fc7eb308cfb72fcb345c1bf77bba2ce45b9ff6a99df536b33798aa5df WatchSource:0}: Error finding container 595c648fc7eb308cfb72fcb345c1bf77bba2ce45b9ff6a99df536b33798aa5df: Status 404 returned error can't find the container with id 595c648fc7eb308cfb72fcb345c1bf77bba2ce45b9ff6a99df536b33798aa5df
Jul 15 20:34:23.993379 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.993338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk" event={"ID":"6c0f9d84-59af-4e82-bf54-b18684952041","Type":"ContainerStarted","Data":"181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a"}
Jul 15 20:34:23.993849 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.993405    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk" event={"ID":"6c0f9d84-59af-4e82-bf54-b18684952041","Type":"ContainerStarted","Data":"595c648fc7eb308cfb72fcb345c1bf77bba2ce45b9ff6a99df536b33798aa5df"}
Jul 15 20:34:23.994133 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:23.994110    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:24.036241 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:24.036190    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk" podStartSLOduration=1.6356029520000002 podStartE2EDuration="2.036174392s" totalImagesPullingTime="400.57144ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:34:24.033009407 +0000 UTC m=+2401.670126697" watchObservedRunningTime="2026-07-15 20:34:24.036174392 +0000 UTC m=+2401.673291682"
Jul 15 20:34:28.872272 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:28.872237    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:34:30.913985 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:30.913949    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"]
Jul 15 20:34:30.917632 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:30.917612    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:30.920530 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:30.920511    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-8e78e5-serving-cert\""
Jul 15 20:34:30.931346 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:30.931322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"]
Jul 15 20:34:31.015892 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:31.015865    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:34:31.016765 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:31.016746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1502b267-6bfb-46dd-864b-8e34c958b648-maas-api-tls\") pod \"maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb\" (UID: \"1502b267-6bfb-46dd-864b-8e34c958b648\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:31.016876 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:31.016789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rkrn\" (UniqueName: \"kubernetes.io/projected/1502b267-6bfb-46dd-864b-8e34c958b648-kube-api-access-4rkrn\") pod \"maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb\" (UID: \"1502b267-6bfb-46dd-864b-8e34c958b648\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:31.016876 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:31.016834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1502b267-6bfb-46dd-864b-8e34c958b648-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb\" (UID: \"1502b267-6bfb-46dd-864b-8e34c958b648\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:31.118347 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:31.118306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1502b267-6bfb-46dd-864b-8e34c958b648-maas-api-tls\") pod \"maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb\" (UID: \"1502b267-6bfb-46dd-864b-8e34c958b648\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:31.118546 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:31.118393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rkrn\" (UniqueName: \"kubernetes.io/projected/1502b267-6bfb-46dd-864b-8e34c958b648-kube-api-access-4rkrn\") pod \"maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb\" (UID: \"1502b267-6bfb-46dd-864b-8e34c958b648\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:31.118546 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:31.118437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1502b267-6bfb-46dd-864b-8e34c958b648-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb\" (UID: \"1502b267-6bfb-46dd-864b-8e34c958b648\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:31.119099 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:31.119075    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1502b267-6bfb-46dd-864b-8e34c958b648-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb\" (UID: \"1502b267-6bfb-46dd-864b-8e34c958b648\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:31.120972 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:31.120927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1502b267-6bfb-46dd-864b-8e34c958b648-maas-api-tls\") pod \"maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb\" (UID: \"1502b267-6bfb-46dd-864b-8e34c958b648\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:31.132646 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:31.132626    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rkrn\" (UniqueName: \"kubernetes.io/projected/1502b267-6bfb-46dd-864b-8e34c958b648-kube-api-access-4rkrn\") pod \"maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb\" (UID: \"1502b267-6bfb-46dd-864b-8e34c958b648\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:31.228846 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:31.228747    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:31.375348 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:31.375322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"]
Jul 15 20:34:31.376770 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:34:31.376737    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1502b267_6bfb_46dd_864b_8e34c958b648.slice/crio-b1374e4a1d508feda9cc8f2690b95e44565ca59c49602889ca04feea6e0ff743 WatchSource:0}: Error finding container b1374e4a1d508feda9cc8f2690b95e44565ca59c49602889ca04feea6e0ff743: Status 404 returned error can't find the container with id b1374e4a1d508feda9cc8f2690b95e44565ca59c49602889ca04feea6e0ff743
Jul 15 20:34:32.048823 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:32.048783    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb" event={"ID":"1502b267-6bfb-46dd-864b-8e34c958b648","Type":"ContainerStarted","Data":"dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09"}
Jul 15 20:34:32.049208 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:32.048843    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb" event={"ID":"1502b267-6bfb-46dd-864b-8e34c958b648","Type":"ContainerStarted","Data":"b1374e4a1d508feda9cc8f2690b95e44565ca59c49602889ca04feea6e0ff743"}
Jul 15 20:34:32.049208 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:32.048969    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:32.067899 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:32.067847    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb" podStartSLOduration=1.6054116010000001 podStartE2EDuration="2.067833773s" totalImagesPullingTime="462.422172ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:34:32.06555232 +0000 UTC m=+2409.702669612" watchObservedRunningTime="2026-07-15 20:34:32.067833773 +0000 UTC m=+2409.704951091"
Jul 15 20:34:38.059470 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:38.059443    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:34:40.690711 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:34:40.690675    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:35:05.066613 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:35:05.066572    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:35:39.469307 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:35:39.469273    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:35:52.984452 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:35:52.984415    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:36:11.469127 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:36:11.469084    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:36:25.192355 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:36:25.192267    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:36:43.077731 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:36:43.077698    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:37:01.578225 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:01.578192    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:37:17.970634 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:17.970600    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:37:36.473739 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:36.473698    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:37:51.600326 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.600294    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"]
Jul 15 20:37:51.603966 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.603946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.606821 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.606800    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c4ecb2\"/\"kube-root-ca.crt\""
Jul 15 20:37:51.607699 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.607679    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c4ecb2\"/\"default-dockercfg-2qh5q\""
Jul 15 20:37:51.607774 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.607722    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c4ecb2\"/\"sub-test-model-c4ecb2-kserve-self-signed-certs\""
Jul 15 20:37:51.607815 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.607723    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c4ecb2\"/\"openshift-service-ca.crt\""
Jul 15 20:37:51.616144 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.616122    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"]
Jul 15 20:37:51.778391 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.778358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-tls-certs\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.778391 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.778391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-tmp-dir\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.778594 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.778470    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjg4k\" (UniqueName: \"kubernetes.io/projected/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-kube-api-access-mjg4k\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.778594 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.778555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-home\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.778594 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.778585    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-dshm\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.778700 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.778601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-model-cache\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.879474 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.879368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-home\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.879474 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.879421    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-dshm\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.879707 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.879550    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-model-cache\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.879707 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.879603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-tls-certs\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.879707 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.879632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-tmp-dir\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.879874 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.879713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjg4k\" (UniqueName: \"kubernetes.io/projected/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-kube-api-access-mjg4k\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.879965 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.879889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-home\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.880044 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.879985    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-model-cache\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.880089 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.880065    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-tmp-dir\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.881810 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.881789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-dshm\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.882092 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.882072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-tls-certs\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.889776 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.889758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjg4k\" (UniqueName: \"kubernetes.io/projected/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-kube-api-access-mjg4k\") pod \"sub-test-model-c4ecb2-kserve-6567d887d9-bffdw\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") " pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:51.912462 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:51.912433    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:37:52.054008 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:52.053962    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"]
Jul 15 20:37:52.056625 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:37:52.056595    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21bb35d6_7b6f_4200_a3e2_d07a9ef12e7d.slice/crio-21c4290cf23521c8608dadc2316cc1a60d6549db9f09143beaed61aea1a70836 WatchSource:0}: Error finding container 21c4290cf23521c8608dadc2316cc1a60d6549db9f09143beaed61aea1a70836: Status 404 returned error can't find the container with id 21c4290cf23521c8608dadc2316cc1a60d6549db9f09143beaed61aea1a70836
Jul 15 20:37:52.128097 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:52.128059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw" event={"ID":"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d","Type":"ContainerStarted","Data":"34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434"}
Jul 15 20:37:52.128253 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:52.128104    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw" event={"ID":"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d","Type":"ContainerStarted","Data":"21c4290cf23521c8608dadc2316cc1a60d6549db9f09143beaed61aea1a70836"}
Jul 15 20:37:52.153491 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:52.153397    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw" podStartSLOduration=1.153378295 podStartE2EDuration="1.153378295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:37:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:37:52.150648946 +0000 UTC m=+2609.787766238" watchObservedRunningTime="2026-07-15 20:37:52.153378295 +0000 UTC m=+2609.790495584"
Jul 15 20:37:54.286319 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:37:54.286283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:38:01.913027 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:38:01.912986    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:38:01.913523 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:38:01.913041    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:38:01.928581 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:38:01.928552    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:38:02.192088 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:38:02.191994    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:38:18.775039 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:38:18.775008    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:38:35.275720 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:38:35.275683    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:38:56.176206 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:38:56.176174    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:39:02.311198 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:02.311160    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"]
Jul 15 20:39:16.167991 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:16.167893    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:39:17.332218 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.332150    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw" podUID="21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d" containerName="main" containerID="cri-o://34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434" gracePeriod=45
Jul 15 20:39:17.582157 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.582133    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:39:17.590831 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.590769    2560 generic.go:356] "Generic (PLEG): container finished" podID="21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d" containerID="34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434" exitCode=0
Jul 15 20:39:17.590831 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.590814    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"
Jul 15 20:39:17.591025 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.590848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw" event={"ID":"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d","Type":"ContainerDied","Data":"34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434"}
Jul 15 20:39:17.591025 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.590885    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw" event={"ID":"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d","Type":"ContainerDied","Data":"21c4290cf23521c8608dadc2316cc1a60d6549db9f09143beaed61aea1a70836"}
Jul 15 20:39:17.591025 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.590902    2560 scope.go:117] "RemoveContainer" containerID="34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434"
Jul 15 20:39:17.600168 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.600133    2560 scope.go:117] "RemoveContainer" containerID="34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434"
Jul 15 20:39:17.600520 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:39:17.600494    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434\": container with ID starting with 34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434 not found: ID does not exist" containerID="34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434"
Jul 15 20:39:17.600591 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.600533    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434"} err="failed to get container status \"34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434\": rpc error: code = NotFound desc = could not find container \"34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434\": container with ID starting with 34d74ef0bff47cca1db049e199d452a5c564d684d8c15c607268be0cfbee3434 not found: ID does not exist"
Jul 15 20:39:17.743460 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.743425    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-home\") pod \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") "
Jul 15 20:39:17.743658 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.743470    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-tmp-dir\") pod \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") "
Jul 15 20:39:17.743658 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.743505    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-model-cache\") pod \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") "
Jul 15 20:39:17.743658 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.743539    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjg4k\" (UniqueName: \"kubernetes.io/projected/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-kube-api-access-mjg4k\") pod \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") "
Jul 15 20:39:17.743658 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.743556    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-tls-certs\") pod \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") "
Jul 15 20:39:17.743658 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.743570    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-dshm\") pod \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\" (UID: \"21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d\") "
Jul 15 20:39:17.743900 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.743745    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-home" (OuterVolumeSpecName: "home") pod "21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d" (UID: "21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:39:17.743900 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.743759    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d" (UID: "21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:39:17.743900 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.743846    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-model-cache" (OuterVolumeSpecName: "model-cache") pod "21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d" (UID: "21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:39:17.745929 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.745903    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-dshm" (OuterVolumeSpecName: "dshm") pod "21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d" (UID: "21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:39:17.746064 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.745959    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-kube-api-access-mjg4k" (OuterVolumeSpecName: "kube-api-access-mjg4k") pod "21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d" (UID: "21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d"). InnerVolumeSpecName "kube-api-access-mjg4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:39:17.746064 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.746035    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d" (UID: "21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:39:17.844902 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.844822    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-home\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:39:17.844902 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.844848    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-tmp-dir\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:39:17.844902 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.844860    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-model-cache\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:39:17.844902 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.844868    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjg4k\" (UniqueName: \"kubernetes.io/projected/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-kube-api-access-mjg4k\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:39:17.844902 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.844876    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-tls-certs\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:39:17.844902 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.844884    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d-dshm\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:39:17.915048 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.915004    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"]
Jul 15 20:39:17.919975 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:17.919919    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c4ecb2/sub-test-model-c4ecb2-kserve-6567d887d9-bffdw"]
Jul 15 20:39:18.894951 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:18.894902    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d" path="/var/lib/kubelet/pods/21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d/volumes"
Jul 15 20:39:22.986205 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:22.986180    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:39:22.999603 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:22.999581    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g2mw_240b2452-aa6d-4036-8696-a2a9b8130697/ovn-acl-logging/0.log"
Jul 15 20:39:27.774559 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:27.774524    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:39:45.169691 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.169657    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"]
Jul 15 20:39:45.170220 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.170200    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d" containerName="main"
Jul 15 20:39:45.170300 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.170222    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d" containerName="main"
Jul 15 20:39:45.170357 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.170329    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="21bb35d6-7b6f-4200-a3e2-d07a9ef12e7d" containerName="main"
Jul 15 20:39:45.174839 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.174804    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.180486 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.180464    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8e78e5\"/\"openshift-service-ca.crt\""
Jul 15 20:39:45.180486 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.180475    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8e78e5\"/\"kube-root-ca.crt\""
Jul 15 20:39:45.181853 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.181830    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8e78e5\"/\"rate-test-model-8e78e5-kserve-self-signed-certs\""
Jul 15 20:39:45.182661 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.182155    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8e78e5\"/\"default-dockercfg-xdwr7\""
Jul 15 20:39:45.186097 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.186075    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"]
Jul 15 20:39:45.284859 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.284825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-model-cache\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.284859 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.284862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-home\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.285112 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.284890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twwv2\" (UniqueName: \"kubernetes.io/projected/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-kube-api-access-twwv2\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.285112 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.284985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-dshm\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.285112 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.285036    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-tmp-dir\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.285112 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.285080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-tls-certs\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.386342 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.386302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-model-cache\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.386511 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.386349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-home\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.386511 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.386379    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twwv2\" (UniqueName: \"kubernetes.io/projected/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-kube-api-access-twwv2\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.386511 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.386403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-dshm\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.386511 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.386454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-tmp-dir\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.386822 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.386679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-tls-certs\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.386822 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.386699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-model-cache\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.386822 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.386728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-home\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.386822 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.386796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-tmp-dir\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.388958 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.388902    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-dshm\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.389076 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.389059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-tls-certs\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.395192 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.395168    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twwv2\" (UniqueName: \"kubernetes.io/projected/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-kube-api-access-twwv2\") pod \"rate-test-model-8e78e5-kserve-7c8bd8867f-5djns\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") " pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.486962 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.486861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:45.628586 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.628546    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"]
Jul 15 20:39:45.630662 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:39:45.630632    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6056fdd_7aed_4a3d_83ee_42adf6abf4f2.slice/crio-6dfd1a458f890f72038b2edb3dde8f2237c99e97a9efe032967f3e98ccaa3bf5 WatchSource:0}: Error finding container 6dfd1a458f890f72038b2edb3dde8f2237c99e97a9efe032967f3e98ccaa3bf5: Status 404 returned error can't find the container with id 6dfd1a458f890f72038b2edb3dde8f2237c99e97a9efe032967f3e98ccaa3bf5
Jul 15 20:39:45.751786 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.751690    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns" event={"ID":"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2","Type":"ContainerStarted","Data":"682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b"}
Jul 15 20:39:45.751786 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.751736    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns" event={"ID":"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2","Type":"ContainerStarted","Data":"6dfd1a458f890f72038b2edb3dde8f2237c99e97a9efe032967f3e98ccaa3bf5"}
Jul 15 20:39:45.788152 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:45.788098    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns" podStartSLOduration=0.788080644 podStartE2EDuration="788.080644ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:39:45.78353746 +0000 UTC m=+2723.420654751" watchObservedRunningTime="2026-07-15 20:39:45.788080644 +0000 UTC m=+2723.425197912"
Jul 15 20:39:49.707498 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:49.707467    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:39:55.487505 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:55.487456    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:55.487505 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:55.487509    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:55.499863 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:55.499832    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:39:55.817373 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:39:55.817294    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:40:10.788265 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:10.788225    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:40:27.084324 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:27.084284    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:40:34.666166 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:34.666135    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"]
Jul 15 20:40:41.070958 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:41.070917    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:40:49.686284 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:49.686244    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns" podUID="a6056fdd-7aed-4a3d-83ee-42adf6abf4f2" containerName="main" containerID="cri-o://682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b" gracePeriod=45
Jul 15 20:40:49.947884 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:49.947819    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:40:50.049277 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.049246    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-dshm\") pod \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") "
Jul 15 20:40:50.049448 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.049303    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-home\") pod \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") "
Jul 15 20:40:50.049448 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.049324    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-tls-certs\") pod \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") "
Jul 15 20:40:50.049448 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.049348    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-tmp-dir\") pod \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") "
Jul 15 20:40:50.049448 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.049384    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-model-cache\") pod \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") "
Jul 15 20:40:50.049448 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.049443    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twwv2\" (UniqueName: \"kubernetes.io/projected/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-kube-api-access-twwv2\") pod \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\" (UID: \"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2\") "
Jul 15 20:40:50.049722 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.049560    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-home" (OuterVolumeSpecName: "home") pod "a6056fdd-7aed-4a3d-83ee-42adf6abf4f2" (UID: "a6056fdd-7aed-4a3d-83ee-42adf6abf4f2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:40:50.049722 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.049616    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a6056fdd-7aed-4a3d-83ee-42adf6abf4f2" (UID: "a6056fdd-7aed-4a3d-83ee-42adf6abf4f2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:40:50.049722 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.049700    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-model-cache" (OuterVolumeSpecName: "model-cache") pod "a6056fdd-7aed-4a3d-83ee-42adf6abf4f2" (UID: "a6056fdd-7aed-4a3d-83ee-42adf6abf4f2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:40:50.049874 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.049763    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-home\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:40:50.049874 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.049779    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-tmp-dir\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:40:50.051615 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.051584    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-dshm" (OuterVolumeSpecName: "dshm") pod "a6056fdd-7aed-4a3d-83ee-42adf6abf4f2" (UID: "a6056fdd-7aed-4a3d-83ee-42adf6abf4f2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:40:50.051615 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.051609    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a6056fdd-7aed-4a3d-83ee-42adf6abf4f2" (UID: "a6056fdd-7aed-4a3d-83ee-42adf6abf4f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:40:50.051758 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.051665    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-kube-api-access-twwv2" (OuterVolumeSpecName: "kube-api-access-twwv2") pod "a6056fdd-7aed-4a3d-83ee-42adf6abf4f2" (UID: "a6056fdd-7aed-4a3d-83ee-42adf6abf4f2"). InnerVolumeSpecName "kube-api-access-twwv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:40:50.109103 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.109075    2560 generic.go:356] "Generic (PLEG): container finished" podID="a6056fdd-7aed-4a3d-83ee-42adf6abf4f2" containerID="682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b" exitCode=0
Jul 15 20:40:50.109244 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.109128    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"
Jul 15 20:40:50.109244 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.109156    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns" event={"ID":"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2","Type":"ContainerDied","Data":"682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b"}
Jul 15 20:40:50.109244 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.109203    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns" event={"ID":"a6056fdd-7aed-4a3d-83ee-42adf6abf4f2","Type":"ContainerDied","Data":"6dfd1a458f890f72038b2edb3dde8f2237c99e97a9efe032967f3e98ccaa3bf5"}
Jul 15 20:40:50.109244 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.109222    2560 scope.go:117] "RemoveContainer" containerID="682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b"
Jul 15 20:40:50.120234 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.120213    2560 scope.go:117] "RemoveContainer" containerID="682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b"
Jul 15 20:40:50.120496 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:40:50.120474    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b\": container with ID starting with 682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b not found: ID does not exist" containerID="682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b"
Jul 15 20:40:50.120563 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.120509    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b"} err="failed to get container status \"682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b\": rpc error: code = NotFound desc = could not find container \"682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b\": container with ID starting with 682aa64fba4f04f1d9561555c9f07a91a5ce01612c8d31b29bd08f03cf6ed59b not found: ID does not exist"
Jul 15 20:40:50.131583 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.131560    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"]
Jul 15 20:40:50.137589 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.137569    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8e78e5/rate-test-model-8e78e5-kserve-7c8bd8867f-5djns"]
Jul 15 20:40:50.150585 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.150567    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-tls-certs\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:40:50.150585 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.150587    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-model-cache\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:40:50.150703 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.150595    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twwv2\" (UniqueName: \"kubernetes.io/projected/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-kube-api-access-twwv2\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:40:50.150703 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.150603    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2-dshm\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:40:50.895303 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:40:50.895273    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6056fdd-7aed-4a3d-83ee-42adf6abf4f2" path="/var/lib/kubelet/pods/a6056fdd-7aed-4a3d-83ee-42adf6abf4f2/volumes"
Jul 15 20:41:04.661915 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:04.661877    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"]
Jul 15 20:41:04.662512 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:04.662142    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk" podUID="6c0f9d84-59af-4e82-bf54-b18684952041" containerName="maas-api" containerID="cri-o://181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a" gracePeriod=30
Jul 15 20:41:04.921554 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:04.921495    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:41:04.971343 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:04.971315    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0f9d84-59af-4e82-bf54-b18684952041-openshift-service-ca\") pod \"6c0f9d84-59af-4e82-bf54-b18684952041\" (UID: \"6c0f9d84-59af-4e82-bf54-b18684952041\") "
Jul 15 20:41:04.971514 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:04.971361    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c0f9d84-59af-4e82-bf54-b18684952041-maas-api-tls\") pod \"6c0f9d84-59af-4e82-bf54-b18684952041\" (UID: \"6c0f9d84-59af-4e82-bf54-b18684952041\") "
Jul 15 20:41:04.971514 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:04.971461    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq7mf\" (UniqueName: \"kubernetes.io/projected/6c0f9d84-59af-4e82-bf54-b18684952041-kube-api-access-dq7mf\") pod \"6c0f9d84-59af-4e82-bf54-b18684952041\" (UID: \"6c0f9d84-59af-4e82-bf54-b18684952041\") "
Jul 15 20:41:04.971650 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:04.971627    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c0f9d84-59af-4e82-bf54-b18684952041-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6c0f9d84-59af-4e82-bf54-b18684952041" (UID: "6c0f9d84-59af-4e82-bf54-b18684952041"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:41:04.971800 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:04.971777    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0f9d84-59af-4e82-bf54-b18684952041-openshift-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:41:04.973591 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:04.973571    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c0f9d84-59af-4e82-bf54-b18684952041-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6c0f9d84-59af-4e82-bf54-b18684952041" (UID: "6c0f9d84-59af-4e82-bf54-b18684952041"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:41:04.973693 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:04.973671    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c0f9d84-59af-4e82-bf54-b18684952041-kube-api-access-dq7mf" (OuterVolumeSpecName: "kube-api-access-dq7mf") pod "6c0f9d84-59af-4e82-bf54-b18684952041" (UID: "6c0f9d84-59af-4e82-bf54-b18684952041"). InnerVolumeSpecName "kube-api-access-dq7mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:41:05.072961 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:05.072913    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq7mf\" (UniqueName: \"kubernetes.io/projected/6c0f9d84-59af-4e82-bf54-b18684952041-kube-api-access-dq7mf\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:41:05.072961 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:05.072955    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c0f9d84-59af-4e82-bf54-b18684952041-maas-api-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:41:05.190139 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:05.190061    2560 generic.go:356] "Generic (PLEG): container finished" podID="6c0f9d84-59af-4e82-bf54-b18684952041" containerID="181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a" exitCode=0
Jul 15 20:41:05.190139 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:05.190111    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"
Jul 15 20:41:05.190139 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:05.190135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk" event={"ID":"6c0f9d84-59af-4e82-bf54-b18684952041","Type":"ContainerDied","Data":"181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a"}
Jul 15 20:41:05.190337 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:05.190176    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk" event={"ID":"6c0f9d84-59af-4e82-bf54-b18684952041","Type":"ContainerDied","Data":"595c648fc7eb308cfb72fcb345c1bf77bba2ce45b9ff6a99df536b33798aa5df"}
Jul 15 20:41:05.190337 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:05.190198    2560 scope.go:117] "RemoveContainer" containerID="181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a"
Jul 15 20:41:05.199431 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:05.199412    2560 scope.go:117] "RemoveContainer" containerID="181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a"
Jul 15 20:41:05.199679 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:41:05.199660    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a\": container with ID starting with 181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a not found: ID does not exist" containerID="181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a"
Jul 15 20:41:05.199719 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:05.199689    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a"} err="failed to get container status \"181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a\": rpc error: code = NotFound desc = could not find container \"181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a\": container with ID starting with 181bf430c1205aaa128afdb0045d224cc6d0b436293f6333d7a8e5af673b452a not found: ID does not exist"
Jul 15 20:41:05.210678 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:05.210652    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"]
Jul 15 20:41:05.213660 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:05.213640    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c4ecb2-8697c4d74c-vmjjk"]
Jul 15 20:41:06.894751 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:06.894721    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c0f9d84-59af-4e82-bf54-b18684952041" path="/var/lib/kubelet/pods/6c0f9d84-59af-4e82-bf54-b18684952041/volumes"
Jul 15 20:41:08.167526 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:08.167493    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:41:31.046564 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.046531    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"]
Jul 15 20:41:31.046926 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.046753    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb" podUID="1502b267-6bfb-46dd-864b-8e34c958b648" containerName="maas-api" containerID="cri-o://dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09" gracePeriod=30
Jul 15 20:41:31.297969 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.297901    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:41:31.334736 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.334690    2560 generic.go:356] "Generic (PLEG): container finished" podID="1502b267-6bfb-46dd-864b-8e34c958b648" containerID="dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09" exitCode=0
Jul 15 20:41:31.334892 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.334738    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"
Jul 15 20:41:31.334892 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.334754    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb" event={"ID":"1502b267-6bfb-46dd-864b-8e34c958b648","Type":"ContainerDied","Data":"dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09"}
Jul 15 20:41:31.334892 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.334808    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb" event={"ID":"1502b267-6bfb-46dd-864b-8e34c958b648","Type":"ContainerDied","Data":"b1374e4a1d508feda9cc8f2690b95e44565ca59c49602889ca04feea6e0ff743"}
Jul 15 20:41:31.334892 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.334838    2560 scope.go:117] "RemoveContainer" containerID="dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09"
Jul 15 20:41:31.344032 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.344014    2560 scope.go:117] "RemoveContainer" containerID="dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09"
Jul 15 20:41:31.344306 ip-10-0-135-197 kubenswrapper[2560]: E0715 20:41:31.344280    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09\": container with ID starting with dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09 not found: ID does not exist" containerID="dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09"
Jul 15 20:41:31.344380 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.344319    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09"} err="failed to get container status \"dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09\": rpc error: code = NotFound desc = could not find container \"dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09\": container with ID starting with dbeb231eaf6235b122ab684a334018f215dc9608fba5863cb16043f8f6b9cd09 not found: ID does not exist"
Jul 15 20:41:31.403643 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.403616    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1502b267-6bfb-46dd-864b-8e34c958b648-maas-api-tls\") pod \"1502b267-6bfb-46dd-864b-8e34c958b648\" (UID: \"1502b267-6bfb-46dd-864b-8e34c958b648\") "
Jul 15 20:41:31.403756 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.403690    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1502b267-6bfb-46dd-864b-8e34c958b648-openshift-service-ca\") pod \"1502b267-6bfb-46dd-864b-8e34c958b648\" (UID: \"1502b267-6bfb-46dd-864b-8e34c958b648\") "
Jul 15 20:41:31.403756 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.403737    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rkrn\" (UniqueName: \"kubernetes.io/projected/1502b267-6bfb-46dd-864b-8e34c958b648-kube-api-access-4rkrn\") pod \"1502b267-6bfb-46dd-864b-8e34c958b648\" (UID: \"1502b267-6bfb-46dd-864b-8e34c958b648\") "
Jul 15 20:41:31.404076 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.404052    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1502b267-6bfb-46dd-864b-8e34c958b648-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1502b267-6bfb-46dd-864b-8e34c958b648" (UID: "1502b267-6bfb-46dd-864b-8e34c958b648"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:41:31.405803 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.405781    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1502b267-6bfb-46dd-864b-8e34c958b648-kube-api-access-4rkrn" (OuterVolumeSpecName: "kube-api-access-4rkrn") pod "1502b267-6bfb-46dd-864b-8e34c958b648" (UID: "1502b267-6bfb-46dd-864b-8e34c958b648"). InnerVolumeSpecName "kube-api-access-4rkrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:41:31.405803 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.405784    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1502b267-6bfb-46dd-864b-8e34c958b648-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1502b267-6bfb-46dd-864b-8e34c958b648" (UID: "1502b267-6bfb-46dd-864b-8e34c958b648"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:41:31.504528 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.504496    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1502b267-6bfb-46dd-864b-8e34c958b648-maas-api-tls\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:41:31.504528 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.504523    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1502b267-6bfb-46dd-864b-8e34c958b648-openshift-service-ca\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:41:31.504693 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.504536    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rkrn\" (UniqueName: \"kubernetes.io/projected/1502b267-6bfb-46dd-864b-8e34c958b648-kube-api-access-4rkrn\") on node \"ip-10-0-135-197.ec2.internal\" DevicePath \"\""
Jul 15 20:41:31.661795 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.661768    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"]
Jul 15 20:41:31.669506 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:31.669483    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8e78e5-5b9bbbd7b5-rgppb"]
Jul 15 20:41:32.895639 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:32.895610    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1502b267-6bfb-46dd-864b-8e34c958b648" path="/var/lib/kubelet/pods/1502b267-6bfb-46dd-864b-8e34c958b648/volumes"
Jul 15 20:41:34.293037 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:34.293003    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gzwg4"]
Jul 15 20:41:52.784679 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:52.784647    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f9b775cb-sps88_1d835bab-d54f-477c-a659-8a47716e7fe9/manager/0.log"
Jul 15 20:41:52.906316 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:52.906291    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fwkqp_bd917117-5236-4434-a47f-30dc3bb51233/server/0.log"
Jul 15 20:41:53.390882 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:53.390858    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57c4dc5856-z2tsq_bf483de4-f69e-4e4b-958c-273147d29a81/copy-manifests/0.log"
Jul 15 20:41:53.397800 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:53.397768    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57c4dc5856-z2tsq_bf483de4-f69e-4e4b-958c-273147d29a81/manager/0.log"
Jul 15 20:41:53.751766 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:53.751678    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-9b9d495d8-fzf5d_70b5f106-2e47-48c4-a6c4-e5a801a4ee29/maas-api/0.log"
Jul 15 20:41:54.083030 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:54.082903    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-c8d33b32-fzxrp_a43611b7-ec66-4cf2-bc63-d0212166de35/revoke-keys/0.log"
Jul 15 20:41:54.648930 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:54.648891    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-bec571-vpxw2_31ad2b99-7274-4110-b39b-e2c865d271ed/revoke-keys/0.log"
Jul 15 20:41:54.875415 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:54.875383    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-7ac342b1-fjv5f_cd01f72c-640e-4b0c-b12c-0c00ab61d948/revoke-keys/0.log"
Jul 15 20:41:55.441262 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:55.441230    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-dsmqp_3fd4d8a3-940b-46d2-92a6-89c7792d99b1/postgres/0.log"
Jul 15 20:41:56.212618 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.212587    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25_88f44f3e-ec88-4fcd-9366-d4321268fb0c/pull/0.log"
Jul 15 20:41:56.220683 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.220660    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25_88f44f3e-ec88-4fcd-9366-d4321268fb0c/extract/0.log"
Jul 15 20:41:56.235156 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.235135    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25_88f44f3e-ec88-4fcd-9366-d4321268fb0c/util/0.log"
Jul 15 20:41:56.346007 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.345987    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw_4b3103ec-7134-40a2-aae8-9532902df2e5/util/0.log"
Jul 15 20:41:56.352126 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.352104    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw_4b3103ec-7134-40a2-aae8-9532902df2e5/pull/0.log"
Jul 15 20:41:56.358081 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.358064    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw_4b3103ec-7134-40a2-aae8-9532902df2e5/extract/0.log"
Jul 15 20:41:56.472597 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.472490    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7_a44afb10-44b0-4a79-a632-06c1f784d07a/util/0.log"
Jul 15 20:41:56.478916 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.478892    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7_a44afb10-44b0-4a79-a632-06c1f784d07a/pull/0.log"
Jul 15 20:41:56.485651 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.485633    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7_a44afb10-44b0-4a79-a632-06c1f784d07a/extract/0.log"
Jul 15 20:41:56.592242 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.592213    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs_d8a4e3c8-90d6-493b-8747-9208c283e440/util/0.log"
Jul 15 20:41:56.601301 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.601279    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs_d8a4e3c8-90d6-493b-8747-9208c283e440/pull/0.log"
Jul 15 20:41:56.608203 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.608184    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs_d8a4e3c8-90d6-493b-8747-9208c283e440/extract/0.log"
Jul 15 20:41:56.961116 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:56.961088    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s98m8_df45955e-8f54-4ba2-8067-5c88de28487e/manager/0.log"
Jul 15 20:41:57.324468 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:57.324393    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2k9dc_a36aefb8-d308-4014-8c21-0b4351a7e0df/manager/0.log"
Jul 15 20:41:57.436884 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:57.436855    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gzwg4_4e76dd33-ed9a-4b83-9ae9-178549d974f6/limitador/0.log"
Jul 15 20:41:58.040202 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:58.040175    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qgzjt_c36b137a-d964-4cc7-9d9b-a22a254548a1/discovery/0.log"
Jul 15 20:41:58.267588 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:58.267548    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c4bdf9b6b-mqddm_4a26fd03-1b9d-42fd-83d1-8f429dbfa810/kube-auth-proxy/0.log"
Jul 15 20:41:59.187772 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:59.187736    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-f9v49_fdb4fbe9-d871-46d6-aa76-7a17cd6da09b/main/0.log"
Jul 15 20:41:59.544290 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:41:59.544204    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4n8tk_9a9a0313-1c2a-4b49-b838-9769ad0438f7/main/0.log"
Jul 15 20:42:05.179057 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.179023    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mncbm/must-gather-k5w2v"]
Jul 15 20:42:05.179443 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.179399    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1502b267-6bfb-46dd-864b-8e34c958b648" containerName="maas-api"
Jul 15 20:42:05.179443 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.179414    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1502b267-6bfb-46dd-864b-8e34c958b648" containerName="maas-api"
Jul 15 20:42:05.179443 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.179427    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6056fdd-7aed-4a3d-83ee-42adf6abf4f2" containerName="main"
Jul 15 20:42:05.179443 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.179433    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6056fdd-7aed-4a3d-83ee-42adf6abf4f2" containerName="main"
Jul 15 20:42:05.179443 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.179444    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c0f9d84-59af-4e82-bf54-b18684952041" containerName="maas-api"
Jul 15 20:42:05.179610 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.179450    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c0f9d84-59af-4e82-bf54-b18684952041" containerName="maas-api"
Jul 15 20:42:05.179610 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.179503    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1502b267-6bfb-46dd-864b-8e34c958b648" containerName="maas-api"
Jul 15 20:42:05.179610 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.179510    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c0f9d84-59af-4e82-bf54-b18684952041" containerName="maas-api"
Jul 15 20:42:05.179610 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.179516    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6056fdd-7aed-4a3d-83ee-42adf6abf4f2" containerName="main"
Jul 15 20:42:05.182329 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.182313    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mncbm/must-gather-k5w2v"
Jul 15 20:42:05.185657 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.185627    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mncbm\"/\"kube-root-ca.crt\""
Jul 15 20:42:05.185657 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.185641    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mncbm\"/\"openshift-service-ca.crt\""
Jul 15 20:42:05.186524 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.186508    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mncbm\"/\"default-dockercfg-f7qnm\""
Jul 15 20:42:05.203209 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.203185    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mncbm/must-gather-k5w2v"]
Jul 15 20:42:05.269387 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.269347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3a880139-8429-48d8-8a05-19a0d3e92070-must-gather-output\") pod \"must-gather-k5w2v\" (UID: \"3a880139-8429-48d8-8a05-19a0d3e92070\") " pod="openshift-must-gather-mncbm/must-gather-k5w2v"
Jul 15 20:42:05.269387 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.269389    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47j6l\" (UniqueName: \"kubernetes.io/projected/3a880139-8429-48d8-8a05-19a0d3e92070-kube-api-access-47j6l\") pod \"must-gather-k5w2v\" (UID: \"3a880139-8429-48d8-8a05-19a0d3e92070\") " pod="openshift-must-gather-mncbm/must-gather-k5w2v"
Jul 15 20:42:05.370293 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.370259    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3a880139-8429-48d8-8a05-19a0d3e92070-must-gather-output\") pod \"must-gather-k5w2v\" (UID: \"3a880139-8429-48d8-8a05-19a0d3e92070\") " pod="openshift-must-gather-mncbm/must-gather-k5w2v"
Jul 15 20:42:05.370293 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.370298    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47j6l\" (UniqueName: \"kubernetes.io/projected/3a880139-8429-48d8-8a05-19a0d3e92070-kube-api-access-47j6l\") pod \"must-gather-k5w2v\" (UID: \"3a880139-8429-48d8-8a05-19a0d3e92070\") " pod="openshift-must-gather-mncbm/must-gather-k5w2v"
Jul 15 20:42:05.370655 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.370631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3a880139-8429-48d8-8a05-19a0d3e92070-must-gather-output\") pod \"must-gather-k5w2v\" (UID: \"3a880139-8429-48d8-8a05-19a0d3e92070\") " pod="openshift-must-gather-mncbm/must-gather-k5w2v"
Jul 15 20:42:05.378800 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.378780    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47j6l\" (UniqueName: \"kubernetes.io/projected/3a880139-8429-48d8-8a05-19a0d3e92070-kube-api-access-47j6l\") pod \"must-gather-k5w2v\" (UID: \"3a880139-8429-48d8-8a05-19a0d3e92070\") " pod="openshift-must-gather-mncbm/must-gather-k5w2v"
Jul 15 20:42:05.490864 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.490783    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mncbm/must-gather-k5w2v"
Jul 15 20:42:05.628873 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.628827    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mncbm/must-gather-k5w2v"]
Jul 15 20:42:05.631050 ip-10-0-135-197 kubenswrapper[2560]: W0715 20:42:05.631024    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a880139_8429_48d8_8a05_19a0d3e92070.slice/crio-c0f350803a5bc91a72311d2dfab4937c017d26f7d6af89ab28441efc40b2dc47 WatchSource:0}: Error finding container c0f350803a5bc91a72311d2dfab4937c017d26f7d6af89ab28441efc40b2dc47: Status 404 returned error can't find the container with id c0f350803a5bc91a72311d2dfab4937c017d26f7d6af89ab28441efc40b2dc47
Jul 15 20:42:05.632841 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:05.632822    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 20:42:06.518974 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:06.518913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mncbm/must-gather-k5w2v" event={"ID":"3a880139-8429-48d8-8a05-19a0d3e92070","Type":"ContainerStarted","Data":"c0f350803a5bc91a72311d2dfab4937c017d26f7d6af89ab28441efc40b2dc47"}
Jul 15 20:42:07.529088 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:07.529048    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mncbm/must-gather-k5w2v" event={"ID":"3a880139-8429-48d8-8a05-19a0d3e92070","Type":"ContainerStarted","Data":"f2ccb27f308377fbda90a13e2eb8f6a7c80fd4d80335315160bdc0e42f521f68"}
Jul 15 20:42:07.529543 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:07.529098    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mncbm/must-gather-k5w2v" event={"ID":"3a880139-8429-48d8-8a05-19a0d3e92070","Type":"ContainerStarted","Data":"2cefe35a5e010b8cb4b100b52b7ec09e33cde9db281301bfeca6fe2ec6a3ae09"}
Jul 15 20:42:08.423321 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:08.423274    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-npph7_a59c139c-c5f1-4bc1-9a89-cc09b82663c5/global-pull-secret-syncer/0.log"
Jul 15 20:42:08.570960 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:08.570896    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lst2f_285224d2-fbcd-482f-8422-9a328b6e726e/konnectivity-agent/0.log"
Jul 15 20:42:08.658978 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:08.658926    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-197.ec2.internal_c92467abfb01b67486eb8e097ce3440a/haproxy/0.log"
Jul 15 20:42:12.760977 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:12.760927    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25_88f44f3e-ec88-4fcd-9366-d4321268fb0c/extract/0.log"
Jul 15 20:42:12.804145 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:12.804082    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25_88f44f3e-ec88-4fcd-9366-d4321268fb0c/util/0.log"
Jul 15 20:42:12.844739 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:12.844652    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncc25_88f44f3e-ec88-4fcd-9366-d4321268fb0c/pull/0.log"
Jul 15 20:42:12.886670 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:12.886636    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw_4b3103ec-7134-40a2-aae8-9532902df2e5/extract/0.log"
Jul 15 20:42:12.922575 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:12.922551    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw_4b3103ec-7134-40a2-aae8-9532902df2e5/util/0.log"
Jul 15 20:42:12.956392 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:12.956364    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n4rbw_4b3103ec-7134-40a2-aae8-9532902df2e5/pull/0.log"
Jul 15 20:42:12.992419 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:12.992360    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7_a44afb10-44b0-4a79-a632-06c1f784d07a/extract/0.log"
Jul 15 20:42:13.023056 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:13.022925    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7_a44afb10-44b0-4a79-a632-06c1f784d07a/util/0.log"
Jul 15 20:42:13.044507 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:13.044460    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x9jl7_a44afb10-44b0-4a79-a632-06c1f784d07a/pull/0.log"
Jul 15 20:42:13.074949 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:13.074894    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs_d8a4e3c8-90d6-493b-8747-9208c283e440/extract/0.log"
Jul 15 20:42:13.101575 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:13.101549    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs_d8a4e3c8-90d6-493b-8747-9208c283e440/util/0.log"
Jul 15 20:42:13.138855 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:13.138829    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t85fs_d8a4e3c8-90d6-493b-8747-9208c283e440/pull/0.log"
Jul 15 20:42:13.535450 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:13.535401    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s98m8_df45955e-8f54-4ba2-8067-5c88de28487e/manager/0.log"
Jul 15 20:42:13.737213 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:13.737176    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2k9dc_a36aefb8-d308-4014-8c21-0b4351a7e0df/manager/0.log"
Jul 15 20:42:13.771877 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:13.771845    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gzwg4_4e76dd33-ed9a-4b83-9ae9-178549d974f6/limitador/0.log"
Jul 15 20:42:16.181684 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:16.181653    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lsdv_3fc10e4b-325e-418f-b855-460074a93fa9/node-exporter/0.log"
Jul 15 20:42:16.205961 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:16.205913    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lsdv_3fc10e4b-325e-418f-b855-460074a93fa9/kube-rbac-proxy/0.log"
Jul 15 20:42:16.233417 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:16.233386    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lsdv_3fc10e4b-325e-418f-b855-460074a93fa9/init-textfile/0.log"
Jul 15 20:42:18.236850 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.236792    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mncbm/must-gather-k5w2v" podStartSLOduration=12.140174822 podStartE2EDuration="13.236769684s" totalImagesPullingTime="1.096594862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:42:07.547005794 +0000 UTC m=+2865.184123084" watchObservedRunningTime="2026-07-15 20:42:18.236769684 +0000 UTC m=+2875.873886971"
Jul 15 20:42:18.238219 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.238186    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"]
Jul 15 20:42:18.242587 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.242560    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.253085 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.253055    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"]
Jul 15 20:42:18.262438 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.262412    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-wqhn4_290bfa79-50ce-45bd-a448-cda6fc5b54c3/networking-console-plugin/0.log"
Jul 15 20:42:18.328566 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.328530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28800be6-4a2c-45a6-aecf-16864bdb3df6-lib-modules\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.328850 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.328826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d45kf\" (UniqueName: \"kubernetes.io/projected/28800be6-4a2c-45a6-aecf-16864bdb3df6-kube-api-access-d45kf\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.329039 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.329021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28800be6-4a2c-45a6-aecf-16864bdb3df6-sys\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.329233 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.329218    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28800be6-4a2c-45a6-aecf-16864bdb3df6-podres\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.329391 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.329376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28800be6-4a2c-45a6-aecf-16864bdb3df6-proc\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.430657 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.430609    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28800be6-4a2c-45a6-aecf-16864bdb3df6-lib-modules\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.430846 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.430671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d45kf\" (UniqueName: \"kubernetes.io/projected/28800be6-4a2c-45a6-aecf-16864bdb3df6-kube-api-access-d45kf\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.430846 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.430706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28800be6-4a2c-45a6-aecf-16864bdb3df6-sys\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.430846 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.430762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28800be6-4a2c-45a6-aecf-16864bdb3df6-podres\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.430846 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.430793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28800be6-4a2c-45a6-aecf-16864bdb3df6-proc\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.430846 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.430818    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28800be6-4a2c-45a6-aecf-16864bdb3df6-lib-modules\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.431169 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.430868    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28800be6-4a2c-45a6-aecf-16864bdb3df6-sys\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.431169 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.430902    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28800be6-4a2c-45a6-aecf-16864bdb3df6-proc\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.431169 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.430926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28800be6-4a2c-45a6-aecf-16864bdb3df6-podres\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.440811 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.440782    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d45kf\" (UniqueName: \"kubernetes.io/projected/28800be6-4a2c-45a6-aecf-16864bdb3df6-kube-api-access-d45kf\") pod \"perf-node-gather-daemonset-z5qwv\" (UID: \"28800be6-4a2c-45a6-aecf-16864bdb3df6\") " pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.555780 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.555696    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:18.757484 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:18.757453    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"]
Jul 15 20:42:19.496165 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:19.496141    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-48n48_746ed836-caef-44c2-8176-39afca487957/download-server/0.log"
Jul 15 20:42:19.638591 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:19.638557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv" event={"ID":"28800be6-4a2c-45a6-aecf-16864bdb3df6","Type":"ContainerStarted","Data":"cf3052deb9bfe31964917e3bda1d7b84ad5e3bdeeb104dc77a7ac965cc438600"}
Jul 15 20:42:19.638776 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:19.638617    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv" event={"ID":"28800be6-4a2c-45a6-aecf-16864bdb3df6","Type":"ContainerStarted","Data":"049836908cd1a5df859ad17e1200802c0623f5dd06b46666a42b09d4d0de3aae"}
Jul 15 20:42:19.638776 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:19.638742    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:19.657185 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:19.657109    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv" podStartSLOduration=1.657087177 podStartE2EDuration="1.657087177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:42:19.654548584 +0000 UTC m=+2877.291665874" watchObservedRunningTime="2026-07-15 20:42:19.657087177 +0000 UTC m=+2877.294204468"
Jul 15 20:42:21.327472 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:21.327443    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m8n8f_f46a85b1-9906-48b0-b399-ece5b1699802/dns/0.log"
Jul 15 20:42:21.354582 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:21.354555    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m8n8f_f46a85b1-9906-48b0-b399-ece5b1699802/kube-rbac-proxy/0.log"
Jul 15 20:42:21.408878 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:21.408845    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6sf8b_c2d28289-371c-4a8f-90d9-445c4717085d/dns-node-resolver/0.log"
Jul 15 20:42:22.022575 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:22.022545    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54c76b8d-h28sd_50c69461-419b-4f01-8b0d-8c067d7a4e5a/registry/0.log"
Jul 15 20:42:22.077390 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:22.077358    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9gbzl_70e0d3b8-298c-4cee-be41-9e559fbd3711/node-ca/0.log"
Jul 15 20:42:23.307627 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:23.307576    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qgzjt_c36b137a-d964-4cc7-9d9b-a22a254548a1/discovery/0.log"
Jul 15 20:42:23.360311 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:23.360277    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c4bdf9b6b-mqddm_4a26fd03-1b9d-42fd-83d1-8f429dbfa810/kube-auth-proxy/0.log"
Jul 15 20:42:24.390468 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:24.390434    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v8qbh_36995e4c-2a4b-4381-8c3d-0f515a4112af/serve-healthcheck-canary/0.log"
Jul 15 20:42:24.904381 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:24.904350    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-7fkxh_90357708-bc2c-41b6-bbe1-13c770dbe384/insights-operator/1.log"
Jul 15 20:42:24.905846 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:24.905823    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-7fkxh_90357708-bc2c-41b6-bbe1-13c770dbe384/insights-operator/0.log"
Jul 15 20:42:25.010777 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:25.010752    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jx28v_5aa9d73d-07f4-4628-85bf-2ab430f58115/kube-rbac-proxy/0.log"
Jul 15 20:42:25.036532 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:25.036505    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jx28v_5aa9d73d-07f4-4628-85bf-2ab430f58115/exporter/0.log"
Jul 15 20:42:25.062666 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:25.062640    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jx28v_5aa9d73d-07f4-4628-85bf-2ab430f58115/extractor/0.log"
Jul 15 20:42:25.657394 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:25.656425    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mncbm/perf-node-gather-daemonset-z5qwv"
Jul 15 20:42:27.982100 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:27.982072    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f9b775cb-sps88_1d835bab-d54f-477c-a659-8a47716e7fe9/manager/0.log"
Jul 15 20:42:28.015978 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:28.015923    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fwkqp_bd917117-5236-4434-a47f-30dc3bb51233/server/0.log"
Jul 15 20:42:28.324444 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:28.324351    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57c4dc5856-z2tsq_bf483de4-f69e-4e4b-958c-273147d29a81/manager/0.log"
Jul 15 20:42:28.349108 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:28.349081    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57c4dc5856-z2tsq_bf483de4-f69e-4e4b-958c-273147d29a81/copy-manifests/0.log"
Jul 15 20:42:28.658959 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:28.658906    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qgzjt_c36b137a-d964-4cc7-9d9b-a22a254548a1/discovery/0.log"
Jul 15 20:42:28.698904 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:28.698877    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c4bdf9b6b-mqddm_4a26fd03-1b9d-42fd-83d1-8f429dbfa810/kube-auth-proxy/0.log"
Jul 15 20:42:29.704421 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:29.704374    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-gvf5f_ffb2da12-1212-4732-bc9d-0980dd953db3/openshift-lws-operator/0.log"
Jul 15 20:42:30.310699 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:30.310663    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qgzjt_c36b137a-d964-4cc7-9d9b-a22a254548a1/discovery/0.log"
Jul 15 20:42:30.344011 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:30.343950    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c4bdf9b6b-mqddm_4a26fd03-1b9d-42fd-83d1-8f429dbfa810/kube-auth-proxy/0.log"
Jul 15 20:42:35.273962 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:35.273860    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-wswf5_12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2/kube-storage-version-migrator-operator/1.log"
Jul 15 20:42:35.274782 ip-10-0-135-197 kubenswrapper[2560]: I0715 20:42:35.274765    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-wswf5_12e7ceaa-b5db-497a-810e-2a3b0d7b3dc2/kube-storage-version-migrator-operator/0.log"